N 

Oi 

CO 

CO 

lO 

o 


THE  ASSESSMENT  OF  ^ 
A JOINT  PROBABILITY 
OISTRIBUTION  ON  AN  EVOLVING 
DYNAMIC  UNCERTAIN  PROCESS 

STANFORD  UNIVERSITY 


Dennis  M.  Buede 


’ D C 


2 13™  ‘I' 


DECISION  TECHNOLOGY 

PDOGDAM 

CYBERNETICS  TECHNOLOGY  OFFICE 

DEFENSE  ADVANCED  RESEARCH  PROJECTS  AGENCY 

Office  of  Naval  Research  • Engineering  Psychology  Programs 


The  objective  of  the  Advanced  Decision 
Technology  Program  is  to  develop  and  transfer 
to  users  in  the  Department  of  Defense  advanced 
management  technologies  for  decision  making. 

These  technologies  are  based  upon  research 
in  the  areas  of  decision  analysis,  the  behavioral 
sciences  and  interactive  computer  graphics. 
The  program  is  sponsored  by  the  Cybernetics 
Technology  Office  of  the  Defense 
Advanced  Research  Projects  Agency  and 
technical  progress  is  monitored  by  the  Office 
of  Naval  Research  - Engineering  Psychology 
Programs.  Participants  in  the  program  are: 

Decisions  and  Designs,  Incorporated 
Harvard  University 
Perceptronics,  Incorporated 
Stanford  Research  Institute 
Stanford  University 
The  University  of  Southern  California 

Inquiries  and  comments  with 
regard  to  this  report  should  be 
addressed  to: 

Dr.  Martin  A.  Tolcott 

Director,  Engineering  Psychology  Programs 
Office  of  Naval  Research 
800  North  Quincy  Street 
Arlington,  Virginia  22217 

or 

LT  COL  Roy  M.  Gulick,  USMC 

Cybernetics  Technology  Office 
Defense  Advanced  Research  Projects  Agency 
1400  Wilson  Boulevard 
Arlington,  Virginia  22209 


j I , onntoinaH  in  this  docuiTient  ate  those  of  the  authorfs)  and  should  not  be  interpreted  as  necessarily 
The  views  or  implied,  of  the  Defense  Advanced  Research  Projects  Agency  or  the  U.S. 

j3^";:rm'rt.Thi:3ocumentra:'b«^^^^^^^^^^  rel^se  with  unlimited  distribution. 


f 


RESEARCH  REPORT  No.  EES  DA-77-5 


JHE  ASSESSMENT  OF  A 
JOINT  fROBABILITY  DISTRIBUTION  ON  AN 
EVOLVING  JJYNAMIC  pCERTAIN  PROCESS. 

-/)  K-  " 


b>f  . 

f'l  0 . Donni'i  NlY^iuede  j 


i I 


- I '1 


DECISION  ANALYSIS  PROGRAM 

Professor  Ronald  A.  Howard 
Principal  Investigator 


Sponsored  by 


Advanced  Research  Projects  Agency 
ARPA  Order  No.  3052 
Under  Sub  contract  from 
(Decisions  and  Designs,  Incorporated 


and 


National  Science  Foundation,  NSF  Grant  ENG  76-8105.6 


-r.  / 


J I [ Sepetcmber-1 97  7 / 

r,cUr-37  5; 


DEPARTMENT  OF  ENGINEERING-ECONOMIC  SYSTEMS 

Stanford  University 
Stanford,  California  94305 


3 9^3  b 


■ToZ 


ABSTRACT 


An  evolving  dynamic  uncertain  process  is  one  of  several 
complicating  factors  in  the  analysis  of  decisions  for  which 
time  is  a critical  element.  A process  is  uncertain  when  its 
output  cannot  be  specified  deterministically;  dynamic  when 
it  and  its  output  change  with  the  passage  of  time;  ana 
evolving  when  the  output  is  revealed  as  time  progresses. 

The  decision  maker's  uncertainty  on  the  dynamic  random 
variable  that  characterizes  such  a process  must  be  ade- 
quately represented  in  any  decision  analysis.  The  direct 
assessment  of  this  uncertainty  is  preferable  to  further 
modeling  when  the  expert's  knowledge  of  the  variable  is 
roughly  equivalent  to  his  knowledge  of  its  components. 

This  dissertation  addresses  the  problem  of  performing 
the  assessment  of  a joint  probability  distribution  on  a 
dynamic  random  variable  in  a practical  manner.  The  first 
approach  to  the  problem  is  to  examine  multivariate  named 
distributions;  they  are  found  to  be  too  rigid  in  their 
structure  to  be  good  approximations  of  the  decision  maker's 
joint  probability  distribution,  in  gener^-^. 

Since  multivariate  named  distributions  are  too  restrictive, 
the  second  approach  is  to  develop  a more  flexible  method  of 
assessing  a joint  probability  distribution  on  a dynamic 


random  variable.  This  method  is  a general  model  of  the 
decision  maker's  use  of  new  information  to  update  his 
probabilistic  beliefs.  A mathematical  framework  for  speci- 
fying a posterior  distribution  in  terms  of  the  prior  distri- 
bution and  the  revealed  information  is  introduced  here. 

This  framework  provides  the  analyst  with  a great  deal  of 
flexibility  for  approximating  any  joint  distribution  the 
decision-maker  might  have. 
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CHAPTER  1 


INTRODUCTION  AND  SUMMARY  OF  RESULTS 

1 . 1 Introduction 

In  many  decision  problems  one  or  more  of  the 
uncertain  variables  is  dynamic.  By  dynamic  we  mean  the 
variable  changes  value  with  the  passage  of  time.  These 
changes  in  value  are  often  critical  in  determining  the 
best  alternative  for  the  decision  maker.  Decision 
analysis  is  the  logical  approach  that  is  most  helpful 
to  the  decision  maker  for  finding  the  best  decision. 

(See  [14]  for  a discussion  of  decision  analysis.; 

However,  the  assessment  of  the  joint  probability  distri- 
bution needed  to  capture  the  decision  maker's  uncertainty 
on  a dynamic  random  variable  (drv)  is  very  difficult. 

This  difficult  assessment  is  directly  related  to  the 
characteristics  of  the  process  that  is  generating  the 
values  of  the  drv.  This  process  is  evolving,  dynamic, 
and  uncertain;  uncertain  because  it  cannot  be  specified 
deterministically  by  the  decision  maker;  dynamic  because 
it  and  its  output,  the  drv,  change  with  the  passage  of 
time;  and  evolving  because  values  of  the  drv  are  dis- 
closed as  time  passes.  The  assessment  of  the  joint 
probability  distribution  on  the  values  of  a drv  in  the 
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time  periods  of  interest  to  the  decision  maker  is 
the  topic  of  this  research. 

The  definition  of  probability  adopted  in  this 
research  will  be  the  Bayesian  definition  (known  as 
subjectivistic  or  personalis tic ) . This  view  asserts 
that  probability  depends  on  the  state  of  information  of 
the  individual.  Thus  it  is  conceivable  that  people 
with  different  states  of  information  will  have  different 
probabilities  for  the  same  set  of  events.  Discussions  of 
this  and  other  definitions  of  probability  can  be  found 
in  references  (9,  20,  27,  301.  Inferential  notation  will 
be  used  to  denote  probabilities.  This  notation  is  dis- 
cussed at  the  end  of  Appendix  A. 
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1.2  The  Problem 


An  e.xamplc  might  be  useful  to  demonstrate  the 
difficulty  inherent  in  assessing  the  joint  probability 
distribution  on  a drv.  Consumpt ion/investment  decisions 
are  faced  by  nearly  every  individual  or  household.  To 
find  the  best  decision  strategy,  these  decisions  must  b^' 
considered  sequentially  since  each  decision  affects  all 
of  the  others.  For  these  problems  it  is  helpful  to 
consider  N discrete  time  periods,  at  the  beginning  of 
which  some  income  is  received  and  during  wliich  consump  * 
tion  takes  place.  The  consumption/investment  decision 
c(i)  is  made  at  the  beginning  of  each  period,  just  after 
the  value  of  that  period's  income  x(i)  is  revealed. 

Por  this  example  wo  will  assume  that  the  difference 
between  the  decision  maker's  wealth  in  period  i and 
his  consumption  in  period  i is  invested  in  a safe  asset 
at  a fixed  rate.  The  crucial  variable  in  this  decision 
is  the  decision  maker's  income  in  each  time  period  since 
each  of  these  values  affects  all  of  th<-  consumption 
decisions.  Unfortunately  each  value  is  uncertain.  But 
even  worse,  there  is  a significant  amount  of  (probabili 
Stic)  dependence  between  the  decision  maker  s income  in 
one  time  period  and  his  income  in  the  other  time  periods. 
This  sequential  decision  is  illustrated  in  Figure  1.1 
with  a decision  tree. 
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In  order  to  calculate  the  optimum  consumption  for  the 
present  period,  a dynamic  programming  problem  must  be  solved. 
(For  a rev'iew  of  dynamic  programming  see  [3].)  This  solution 
necessitates  the  calculation  of  the  optimum  consumption  in 
each  time  period  for  all  possible  values  of  income  and 
consumption  in  the  previous  time  periods.  Thus  a posterior 
probability  distribution  for  each  period's  income  is  needed. 
These  probability  distributions  must  be  conditioned  on  every 
possible  previous  path  of  the  income  variable.  These 
probability  distributions 

{x(l)  lU 
{x(2)  |x(l) 

• • • 

{x(N) |x(N-l) ,x(N-2) ,...,x(l),C} 

are  sufficient  to  specify  the  joint  probability  distribution 
on  X (1) ,x (2) , . . . ,x  (N) . It  is  clear  that  direct  assessment 
of  these  probability  distributions  would  be  excessively 
difficult,  if  not  impossible,  even  if  the  random  variable 

were  discretized.  For  example,  if  we  discretized  income 

ZN-1 

33 

j = 0 

distributions  assuming  no  conditional  independencies.  Even 
if  there  were  some  conditional  independencies,  this  would 
still  be  a large  number  for  N greater  than  five  or  six. 
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Assessment  problems  of  this  type  plague  the  solution 
of  many  dynamic  decision  problems,  even  some  that  are 
not  sequential  decisions  like  the  previous  example.  The 
probabilistically  dependent  structure  of  a drv  is  the 
rule  rather  than  the  exception  for  these  decisions. 

That  is,  the  value  of  x(j)  will  provide  some  infor- 
mation about  the  value  of  x(i),  (jv  i). 

Now  it  is  important  that  we  specify  more  carefully 
the  type  of  drv  being  dealt  with  in  this  research. 

First,  we  must  state  that  che  results  of  this  research 
concerning  the  assessment  of  a joint  probability  distri- 
bution on  a drv  are  to  be  applied  during  the  probabilis- 
tic phase  [14,  p.  284]  of  a decision  analysis.  That 
is,  we  have  completed  the  deterministic  phase  of  the 
analysis  and  have  a deterministic  model  of  the  decision 
that  identifies  the  crucial  uncertain  variables  whose 
probability  distributions  are  now  to  be  assessed.  Thus 
we  have  decided  that  we  should  do  no  further  modeling 
of  the  many  aspects  of  the  decision,  only  assessment. 

Our  research  here  is  concerned  with  how  the  assessment 
of  a joint  probability  distribution  on  a drv  can 
be  done  in  a practical  yet  rigorous  manner. 
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Besides  the  probabilistic  dependence  of  the  periodic 
values  of  the  drv  there  are  three  other  characteristics 
of  a drv  which  will  complete  its  specification  for  this 
research.  The  first  is  the  independence  between  the 
drv  and  all  decision  variables.  If  this  were  not  satis- 
fied/ the  assessments  would  also  have  to  be  made  for 
all  values  of  the  decision  variables.  Decision  analysts 
have  found  that  most  practical  problems  can  be  structured 
in  such  a way  that  there  is  probabilistic  independence 
between  decision  and  state  variables.  Thus  this  condi- 
tion is  usually  satisfied  in  practice. 

The  second  characteristic  of  a drv  is  that  it 
is  probabilistically  independent  of  all  of  the  other 
variables  in  the  decision.  In  other  words,  the  only 
information  that  will  change  the  decision  maker's 
probability  distribution  on  the  value  of  a drv  in  a 
given  time  period  is  the  values  of  the  drv  in  the  previous 
time  periods.  Decision  analysts  have  also  found  that 
many  problems  can  be  structured  so  that  this  condition 
is  met.  It  may  not  be  possible  to  achieve  in  all 
decision  problems,  but  we  will  have  a better  idea  of  how 
to  deal  with  this  situation  when  we  have  found  a conve- 
nient way  to  assess  the  joint  distribution  when  it  is 
satisfied. 
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The  inability  of  the  decision  maker  to  assume  that 
the  evolving  dynamic  uncertain  process  (which  is  gener- 
ating the  values  of  the  drv)  is  stationary,  is  the  third 
characteristic.  ^For  a discussion  of  statior.ary  processes 
see  [4,  19].)  If  this  process  were  stationary,  there 
would  be  a set  of  deterministic  relationships  among 
the  periodic  values  of  the  drv  such  that  a small  number 
of  probability  distributions  would  describe  all  of  the  un- 
certainty on  the  drv.  Thus  the  state-of-the-art  can 
currently  handle  the  assessment  of  a joint  distribution  on  a 
drv  being  generated  by  a stationary  process.  However,  in 
this  research  the  generation  process  of  the  drv  is  assumed 
to  be  changing  over  time  in  a stochastic  manner  and  is 
therefore  nonstationary.  An  important  aspect  of  a non- 
stationary process  is  that  the  more  recent  an  observation, 
the  more  influential  it  will  be  in  updating  the  probability 
distributions  on  future  values  of  the  drv.  This  method 
can  also  be  used  when  the  drv  is  being  generated  by  a 
stationary  process.  However  , nonstationary  processes  are 
the  ones  that  we  are  least  equipped  to  handle. 

Now  that  the  problem  has  been  defined,  a few  words 
about  the  important  aspects  of  its  solution  should  be 
presented.  The  principal  aspects  of  any  probability 
assessment  technique  are  its  theoretical  foundations. 
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its  informational  requirements,  and  its  flexibility  for 
adequately  approximating  any  probabilistic  beliefs. 
First,  the  solution  should  be  theoretically  based  on 
the  concepts  of  probability  theory.  The  probabilistic 
updating  process  on  the  value  of  x(i)  should  be 
well  defined  in  terms  of  the  revealed  information, 

X (1) ,x (2) , . . . ,x (i-1) , being  used  to  transform 
the  prior,  {x(i)  /to  the  posterior, 

{ X (i)  |x  (i-1)  , . . . ,x  (1)  , 4 }. 

The  informational  requirements  of  the  decision 
maker  should  be  kept  at  a practical  level.  Obviously 
the  less  information  he  has  to  supply  in  order  for  the 
analyst  to  specify  his  joint  probability  distribution, 
the  better  the  method.  Typically,  the  analyst  will  have 
to  make  a trade-off  between  obtaining  more  information, 
which  increases  the  cost  of  the  analysis,  and  settling 
for  less  precision  by  making  do  with  what  ho  currently 
has. 


Finally  the  most  discriminating  attribute  of  the 
assessment  methods  investigated  was  their  flexibility 
for  approximating  any  of  the  many  possible  probabilistic 
beliefs  that  a decision  maker  might  have.  Since  the 
mean  and  variance  of  a probability  distribution  are  often 
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its  most  important  descriptors,  the  relationships  between 
the  posterior  mean  (or  median)  and  variance  of  x(i)  and 
the  revealed  values  of  x (1) ,x (2) , . . . ,x (i-1)  were  taken 
to  be  indications  of  the  flexibility  of  the  approximation 
methods.  That  is,  the  number  of  different  types  of 
functional  relationships  between  the  posterior  mean  (median) 
and  variance  and  the  revealed  path  that  a method  could 
exhibit  is  a measure  of  its  flexibility.  This  will  be 
discussed  in  much  greater  detail  in  later  chapters. 

1 . 3 Summary  of  Results 

The  major  contribution  of  this  research  is  a practical 
method  for  approximating  a decision  maker's  joint  proba- 
bility distribution  on  a dynamic  random  variable.  This 
method  includes  both  a mathematical  framework  for  speci- 
fying a joint  distribution  and  an  assessment  procedure. 

The  mathematical  framework  is  original  to  this  research 
and  has  proven  in  seven  assessments  to  be  robust.  The 
assessment  procedure  uses  state-of-the-art  encoding  tech- 
niques to  gather  the  necessary  infontation  needed  by  the 
analyst  to  dress  the  mathematical  framework. 

Another  contribution  is  a formalization  of  the 
difficulties  inherent  in  a solution  to  this  problem  and 


< 


10 


a general  discussion  of  several  possible  solutions. 

Chapter  2 provides  a summary  of  the  three  most 
useful  multivariate  named  distributions — the  normal, 
lognormal,  and  Student-- that  can  be  used  to  characterize 
a decision  maker's  uncertainty  on  a drv.  The  contribution 
here  is  an  evaluation  of  these  distributions  for  use  in  this 
particular  way. 

The  mathematical  framework  of  the  method  for  approx- 
imating a joint  distribution  on  a drv  is  completely 
presented  in  chapter  3.  Section  1 is  a brief  introduction 
to  the  general  aspects  of  the  method.  The  nature  of 
this  framework  is  completely  developed  in  the  second 
section,  including  the  assumptions  and  mathematical  details. 
The  third  section  then  discusses  a relaxation  of  one  of 
the  assumptions  in  order  to  make  the  method  more  gener- 
ally applicable.  Section  4 identifies  and  discusses 
the  sources  of  error  in  this  approximation  technique. 

The  assessment  procedure  is  presented,  step  by  step, 
in  chapter  4.  This  procedure  uses  recognized  encoding 
techniques  and  mathematical  manipulations  to  ascertain 
systematically  the  form  and  parameters  of  the  proper 
mathematical  framework  to  approximate  the  decision 
maker's  uncertainty. 
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Chapter  5 then  presents  a discussion  of  seven  assess- 
ments that  we  performed.  A general  overview  is  provided  in 
the  second  section  to  highlight  their  characteristics  and 
associated  errors.  One  of  our  assessments  is  then  presented 
in  detail  to  illustrate  the  workings  and  usefulness  of  this 
assessment  technique. 

Chapter  6 presents  our  conclusions  and  some  thoughts  on 
areas  for  future  research. 

1.4  Related  Work 


There  has  been  no  thorough  treatment  of  this  problem 
previous  to  this  research.  In  the  past,  assessments  of  these 
type  have  been  simplified  by  assumptions,  such  as  linearity 
or  s tationarity . 

Bather  [2]  and  North  [24]  have  investigated  a similar 
problem.  They  assumed  that  the  decision  is  not  directly 
affected  by  the  values  of  the  drv  x but  by  a parameter  0 
vhich  describes  the  generation  of  the  drv.  However  , the 
decision  maker  is  only  able  to  observe  values  of  x,  the 
drv.  The  generation  process  of  £ is  assumed  to  be  Markov 
in  the  sense  that  the  distribution  {e  (i)  | 0 (i-1) , U is 
probabilistically  independent  of  the  previous  values  of 
(6  (1) ,6  (2) , . . . ,0 (i-2) ) for  i between  2 and  N.  This 
Markov  assumption  is  impractical  for  the  general  drv  and  was 
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not  considered  for  this  research.  Also  , the  actual  value 
of  the  drv  will  be  observed  as  time  evolves,  so  this  problem 
does  not  seem  to  be  as  directly  relevant  as  the  one  being 
investigated  in  this  research. 

Several  other  possible  solutions  have  been  investigated 
by  the  author.  One  possible  solution  involves  the  assess- 
ment of  the  probabilities  on  the  paths  that  the  drv  will 
take  over  time.  It  will  be  easier  to  describe  this  method 
if  we  assume  time  is  continuous,  and  we  are  interested  in 
the  values  of  the  drv  in  the  interval  of  time  (0,t),  There 
are  an  infinite  number  of  paths  the  drv  could  follow  in  this 
interval  of  time  , and  each  path  can  be  described  by  a function 
tion  X (t)  which  need  not  be  continuous  or  restricted  in 
any  other  way.  Of  course  we  could  assume  some  general 
restriction  - but  it  will  become  clear  that  this  will  not 
really  solve  the  problems  inherent  in  the  method.  (Note 
that  the  paths  cannot  be  restricted  to  be  finite  in  number 
because  then  there  will  always  be  some  fraction  of  the  path 
which  could  be  revealed  such  that  the  future  is  certain. 

This  is  not  a sufficiently  good  representation  of  reality  to 
be  useful.)  The  approach  would  then  be  to  encode  a proba- 
bility distribution  on  the  possible  paths  x may  take  over 
time.  Then  after  a certain  amount  of  time  has  passed,  say 
t'<t,  and  a partial  path  has  been  revealed,  the  analyst  can 
use  this  probability  distribution  and  the  probability 
calculus  to  find  the  posterior  distribution  on  the  paths  of 
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X from  time 


T ' to  T given  the  partial  path  from  0 to 
t'.  If  some  sort  of  conjugate  distribution  exists,  this 
operation  could  be  done  analytically.  The  assessed  distribu- 
tion on  the  paths  of  x provides  all  of  the  probabilistic 
information  needed  to  determine  the  probability  distribution 
on  X at  a specific  time  t given  any  state  of  informa- 
tion . 


Unfortunately,  we  are  not  equipped  either  mathemati- 
cally or  practically  to  handle  information  in  the  form  of 
paths.  To  begin  with,  there  are  an  infinite  number  of  paths 
that  the  drv  can  follow  between  any  two  points  in  time. 
However,  this  is  not  the  half  of  it  (figuratively  speaking). 
The  number  of  integers  and  the  number  of  real  numbers 
between  0 and  “ represent  two  different  orders  of  infin- 
ity. (See  [11]  for  a complete  discussion  of  this.)  However, 
the  number  of  functions  that  map  t into  x over  a finite 
time  interval  is  an  even  higher  order  of  infinity  than  these 
two.  (For  a proof  of  this  see  [23] .)  A passage  from  Georgescu- 
Roegen  [12,  pp.  76-77]  sums  up  this  situation: 

"As  we  say  in  mathematics,  the  continuum  of  the 
real  number  system  forms  only  a simple*  infinity. 


*Underlined  text  denotes  italics  in  original. 
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The  suggestion,  natural  at  this  juncture,  of  using 
more  than  one  real  number,  i.e.,  a vector,  for  labeling 
qualities  would  still  not  reduce  quality  to  number. 

For,  as  set  theory  teaches  us,  no  matter  how  many 
coordinates  we  add,  no  set  of  v'ectors  can  transcend 
simple  infinity  in  power.  ...  the  next  higher  cardinal 
number  mathematics  has  been  able  to  construct  after 
that  of  the  arithmetical  continuum  is  represented  by 
the  set  of  functions  of  a real  variable,  i.e.,  by  a set 
of  forms.  Clearly  then,  forms  cannot  be  numbered." 

Questions  one  might  be  tempted  to  ask  at  this  point  are.  Is 
it  really  this  mathematical  complexity  of  infinity  that 
renders  this  method  impractical?  After  all,  wo  have  been 
encoding  probability  density  functions  on  continuous  random 
variables  without  any  trouble.  Is  not  the  problem  one  of 
giving  a cardinal  or  even  ordinal  labeling  to  these  paths  on 
functions  of  x?  If  this  could  be  done,  the  method  would  be 
usable.  For  then  the  paths  could  be  labeled  in  an  ordinal 
way,  and  comparative  questions  could  be  asked  about  these 
paths.  The  point  being  made  by  Georgescu-Roegen  is  that  the 
infinity  of  paths  cannot  be  numbered  or  labeled  by  any 
finite  set  of  continuous  numbers.  Thus,  until  mathemati- 
cians have  devised  a labeling  procedure  for  sets  whose 
numbers  of  elements  belong  to  his  higher  order  of  infinity, 
the  method  is  impractical. 
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Even  if  such  a labeling  procedure  were  available,  it 
would  not  be  useful  unless  people  were  sufficiently  familiar 
with  it  to  answer  the  type  of  questions  asked  in  encoding 
sessions.  For  instance,  we  can  assume  discrete  time  periods, 
and  the  problem  of  the  higher  order  of  infinity  vanishes. 

Now  we  can  use  a vector  to  label  the  past  values  of  the  drv, 
namely  the  vector  of  its  previous  values.  However,  we  still 
have  the  problem  of  being  able  to  label  systematically  the 
infinite  number  of  revealed  vectors  in  terms  such  that 
people  can  answer  questions  like;  "Is  this  set  of  paths  as 
likely  as  that  set"?  or  "Would  you  rather  bet  on  the  blue 
area  of  the  wheel  of  fortune  or  the  likelihood  that  one  of 
the  paths  in  ...  set  of  paths  will  actually  occur"?  Thus, 
even  if  we  assume  discrete  time  and  can  avoid  the  mathemati- 
cal problems  of  higher  orders  of  infinity,  this  method  does 
not  appear  to  be  of  practical  value  because  people  do  not 
think  in  terms  of  sets  of  paths  and  have  a difficult  time 
answering  these  types  of  questions.  Even  assumptions  about 
the  admissable  shape  of  the  paths,  such  as  continuity,  do 
not  dissolve  this  very  practical  problem  of  human  familiarity. 

Another  general  area  of  research  that  could  be  applied 
as  a solution  to  this  problem  is  that  of  linear  system 
theory.  (See  [7,  18].)  This  theory  consists  of  linear  models 
of  dynamic  systems  with  various  degrees  of  uncertainty 
ranging  from  certainty  to  uncertainty  of  the  parameters  as 
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well  as  the  exact  form  of  the  model.  The  most  used  part  of 
this  theory  with  uncertainty  consists  of  a known  linear 
model  with  known  parameters  and  known  additive  noise. 

However , the  assumptions  made  for  this  model  imply  the  equiv 
alent  of  a multivariate  normal  distribution  on  the  drv. 

This  is  one  of  the  methods  which  was  researched  and  which 
will  be  described  in  Chapter  2.  There  are  characteristics 
about  the  multivariate  normal  distribution  which  make  it 
useful  to  control  engineers  but  unfortunately  not  very 
useful  for  the  topic  of  this  research.  This  is  the  type  of 
uncertainty  that  is  often  used  in  dynamic  programming 
problems. 

Another  subset  of  linear  system  theory  postulates  a 
linear  model  with  uncertain  parameters  and  uncertain  addi- 
tive white  noise.  This  problem  has  been  examined  in  several 
places  [21,  25,  31],  and  was  thoroughly  investigated  as  a 
solution  to  this  problem  by  the  author  [5].  However,  there 
are  numerous  mathematical  and  practical  problems  which  make 
this  approach  infeasible.  First,  this  approach  presupposes 
that  the  decision  maker  can  provide  the  analyst  with  a prior 
joint  probability  distribution  on  the  parameters  of  this 
model.  These  param.eters  do  not  exist  and  have  no  intuitive 
meaning  to  the  decision  maker.  Few  assessments  of  this  type 
have  been  attempted  and  none  have  been  reported  successful. 
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Second  , the  flexibility  of  this  method  is  quite  restricted. 
The  relationships  between  the  posterior  median  and  standard 
deviation  and  the  revealed  path  are  very  limited. 

The  development  of  sufficient  statistics  for  specifying 
the  joint  distribution  was  also  investigated  [6].  Rather 
than  defining  the  posterior  distribution 

{x (i)  I X (i-1) , . . . ,x  (1) , in  terms  of  the  revealed  path 
X (1)  , , . . . ,x  (i-1)  , , we  attempted  to  develop  a set  of  sufficient 

Y (|) 

statistics  that  adequately  summarized  this  information. 
However,  this  approach  also  failed  because  it  did  not  have 
the  flexibility  to  capture  many  different  types  of  proba- 
bilistic beliefs. 

Finally  , an  axiomatic  approach  was  investigated.  This 
approach  attempted  to  map  one  or  more  sets  of  axioms  that 
the  decision  maker  might  believe  about  any  stochastic 
process  into  the  subspace  of  possible  joint  probability 
distributions  on  the  process.  The  complexity  of  the  joint 
probability  distributions  encountered  in  practice  was 
partially  responsible  for  keeping  this  approach  on  the 
blackboard.  An  additional  complication  was  the  number  of 
axiomatic  structures  needed  to  provide  a mutually  exclusive 
and  nearly  collectively  exhaustive  covering  of  the  set  of 
possible  beliefs.  Some  examples  of  the  possible  beliefs 
about  the  uncertainty  on  a drv  are  discussed  in  chapter  4, 
section  3. 
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CHAPTER  2 


THE  METHOD  OF  MULTIVARIATE  NAMED  DISTRIBUTIONS 

2 . 1 Introduction  and  Summary 

In  this  chapter  we  will  thoroughly  examine  and 
evaluate  the  most  obvious  method  for  approximating  the 
decision  maker's  joint  probability  distribution  on  a drv 
that  characterizes  an  evolving  dynamic  uncertain  process. 
This  is  probably  the  most  direct  solution  to  this  problem 
in  terms  of  information  required  and  ease  of  assessment. 
However,  since  these  named  distributions  are  so  structured, 
we  would  expect  their  flexibility  to  be  quite  restricted. 

By  flexibility  we  mean  the  ability  of  one  method  to 
approximate  adequately  any  of  the  many  possible  probabi- 
listic beliefs  that  a decision  maker  might  have. 

The  multivariate  named  distributions  examined 
during  this  research  were  the  following;  the  normal, 
lognormal.  Student,  inverted  Dirichlet  (beta),  Pareto, 
and  several  gamma's.  The  major  source  of  information 
on  these  distributions  is  [16].  The  multivariate  normal 
and  Student  distributions  are  also  discussed  in  [10,25] 
while  the  multivariate  lognormal  is  presented  in  [17], 

All  but  the  normal,  lognormal,  and  Student  distributions 
are  characterized  by  complicated  joint,  prior,  and 
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posterior  density  and  cumulative  functions.  Therefore  only 
these  three  multivariate  distributions  were  considered  use- 
ful and  are  discussed  in  this  chapter. 


Sections  2,  3,  and  4 of  this  chapter  discuss  the 
characteristics  of  the  normal,  lognormal  and  Student  dis 
tributions,  respectively. 


2 . 2 The  Multivariate  Normal  Distribution 

The  N-dimensional  multivariate  normal  distribution  is 
characterized  by  an  N-dimensional  vector  of  means  and  a 

NxN-dimensional  covariance  matrix 

P(l)' 

Vi  = U(2)  (2.1(a)) 

i(N) 

(2.1(b)  ) 


0(1)^ 

P^20(1)o(2)  . 

. . p^^o(l)a(N) 

^2^ (1)0(2) 

0(2)^ 

• • 

. . P2j,j0  (2)  0 (N) 

• 

P2j^o(2)o(N)  . 

. . • a(N)^ 

The  covariance  matrix  is  symmetric  and  positive-definite. 
Thus,  there  are  only  Js(N^+N)  distinct  elements  of  the 
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matrix.  The  N-dimensional  joint  density  function  of  the 
multivariate  normal  is 


{xlU  = (x|y,I) 

(2.2) 

__N 

= (27t)  Z i"^exp(-ii(x-y)  ) . 


To  determine  the  prior  and  posterior  distributions  of  the 
multivariate  normal  we  must  first  partition  the  vectors  and 
matrices  as  follows: 


x=  (xd) x(q)|x{q+l) x(N))'  = (xdxj)', 

y = (y(l) y(q)ly(q+l), (N)  ) ’ = 


Z 


P 


z 

— 1 2 
z 


p 

— 1 1 
p 

— 2 1 


P 

— 1 2 
P 

— 2 2 


where  Z is  qxq, 
— 1 1 


where  P is  qxq. 
—1  1 


(2.3) 


Note  that  since  Z is  the  covariance  matrix,  P can  be 
interpreted  as  the  precision  matrix.  Then  the  general 
prior  and  posterior  distributions  can  be  written  as: 


lU 


(2.4) 
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{x  lx 
~2  — 1 


U = f 
^ n 


U +I  (X  -y  ) , (I  -I  l-'^Z 

—2  —21  — 11  —1  —1  —2  2 —21—11—: 


) ) 


^ f(N-q) 
n 


(X 
— 2 


y -P-^P  (x  -y  ) ,P-M  . 
—2—2  2—2  1—1—1  2 2 


(2.5) 


See  [25]  for  a proof  of  this.  Note  that  all  prior  and  poste- 
rior distributions  of  a multivariate  normal  are  either  multi- 
variate or  univariate  normal  distributions. 


It  is  important  to  note  at  this  point  that  an  implicit 
assumption  of  this  multivariate  distribution  is  the  follow- 
ing: the  information  that  is  contained  in  the  revealed  path 

(the  values  of  x (1 ) , x (2 ) , . . . ,x (i-1 ) ) and  that  is  to  be  used 
to  update  the  prior  distribution  on  x(i)  can  be  totally 
described  by  the  covariances  between  the  periodic  values 
taken  two  at  a time.  In  some  cases  this  can  be  too  great  a 
simplification  of  reality.  For  these  cases  this  method  would 
not  yield  a very  satisfactory  approximation  of  the  decision- 
maker's joint  probability  solution.  None  of  the  assessments 
we  did  would  have  been  adequately  approximated  by  this 
distribution . 

In  order  to  determine  the  flexibility  of  the  multi- 
variate normal  distribution  we  must  examine  the  relationships 
between  the  posterior  mean  and  variance  of  x(i)  and  the 
revealed  path,  x (1) , x (2 x (i-1 ) . The  posterior  mean 

<x  lx  ,K>  = y J:"Mx  -y  ) (2-6) 

— 2'— 1 —2  —2  1—11  ~1  ”1 
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is  a linear  combination  of  the  revealed  values  of  the  drv . 
This  is  the  simplest  nontrivial  approximation  one  could 
assume.  In  fact  it  suggests  the  assessment  procedure  for 
the  multivariate  normal  distribution  described  in  [15] . It 
should  be  noted  though  that  there  is  a restriction  placed  on 
this  linear  relationship  between  the  posterior  mean  and  a 
revealed  value  of  the  drv.  This  is  that  the  posterior  mean 
of  x(i)  given  that  x(j)  (j<i)  equals  its  prior  mean  is 
equal  to  the  prior  mean  of  x(i): 

<x(i)|x(j)  = <x(j)lC>fC>  = <x{i)|C>.  (2.7) 

In  fact  it  is  proven  in  Appendix  B that  this  relationship  is 
true  whenever  the  posterior  mean  is  a linear  combination  of 
the  variables,  regardless  of  the  specific  joint  probability 
distribution. 


The  posterior  variance 


is  a constant  and  therefore  independent  of  the  revealed 
path.  This  was  a particularly  poor  approximation  for 
all  of  the  assessments  we  did.  There  is  an  even  greater 
limitation  here  though.  It  is  that  once  the  parameters 
of  the  multivariate  normal  distribution  have  been  deter- 
mined by  the  above-mentioned  assessment  procedure,  the 
posterior  variances  are  all  determined.  In  other  words. 
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once  the  decision  maker  has  indicated  how  his  posterior 
means  should  be  updated,  he  has  no  freedom  for  speci- 
fying how  the  other  characteristics  of  his  posterior 
distributions  should  be  updated.  In  fact,  he  may  find 
that  for  some  seemingly  reasonable  correlation  coefficients, 
the  covariance  matrix  is  not  positive-definite. 

These  characteristics  of  the  multivariate  normal 
distribution  indicate  that  it  has  very  little  flexibility 
for  approximating  a decision  maker's  uncertainty  on  a 
drv  and  could  only  be  used  as  a crude  first  approximation. 
However,  it  is  the  approach  used  quite  often  in  the  dynamic 
programming  literature. 

2. 3 The  Multivariate  Lognormal  Distribution 

The  N-dimensional  multivariate  lognormal  distribution 
on  ^ is  obtained  via  the  transformation: 

x(i)  = ln(2(i)) , (i=l,2,...,N)  (^.9) 


on  X when  the  joint  distribution  on  x is  multivariate 
normal.  The  multivariate  lognormal  density  function  is 


(2.10) 


{z  I U = (z  |y  ,1) 

_N  ^ 

= (2tt)  ^1^1  "^  ( TT  2 (i)  ) • 
i=l 

exp(-i5  (ln(2)-i£)  ' I-Mln  (z)-y)  ) , 

2 (i) >0,  (i=l,2, . . . ,N) . 


Using  the  partitions  of  section  2,  the  prior  and  posterior 

distributions  on  2 can  be  derived  (see  [17]): 

— 2 


{2  lU  = (Z  |U  ) (2.11) 

— 2 in  — 2 ~2  — 2 2 

{2  \z  |y  +l  Z"Mln(2  )-y  ), 

—2  —1  In  —2  —2  —2  1—11  —1  —1 


(Z  -Z  Z-‘Z  )) 
—22  —21—11—12 


= f(N-q) 
In 


I ) 
— 2 1 


(2.12) 


Note  that  both  the  prior  and  posterior  distributions  are 
lognomal . 


Some  properties  of  the  multivariate  lognormal  distri- 
bution are: 

z(ik)  = exp[y(i)]  (2.13(a)) 

<2(i)|^>  = exp  [y  (i)+J50  (i)  ] (2.13(b)) 

<2(i)l^>  = exp  [2y (i)+o (i) ] (exp[o (i) ] -1) 

= <2  (i) I (exp [o (i) ] -1) 

(i=l,2, . . . ,N) . 
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(2.13(c) ) 


z(q+l|q)  = exp  [p  (q+1) +Z  , I Z Mln(2  ) -y  )] 
'j  . 5 -q+l|q-ii  -1  -1 


= sxPfllq  + llq: 


(2.14 (a)  ) 


2(1), = ^^P(Vl|q"’''Vl|q-’i^+l|q^ 

= ^^P^VHq-^'^VlIq^  (2.14(b)) 

Xz  (q+1)  I 2 (q)  , . . . , 2 (1)  , = <2  (q+1)  I 2 (q)  , . . . , 2 (1)  , . 

(exp[a^_^^|^]-l)  (2.14(c)) 

(q  = 1,2, .. . ,N-1) . 


Note  that  the  posterior  median  and  mean  reduce  to  the  form 

a 2(l)^'2(2)^'...2(q)^q  (2.15) 

0 

with  different  values  for  the  constant  a , respectively. 

0 

The  posterior  variance  is  another  constant  times  the 
square  of  the  posterior  mean.  In  this  case  the  posterior 
variance  is  dependent  on  the  revealed  path  although  the 
coefficient  of  variation  for  the  posterior  distributions 
is  not.  Finally,  the  cumulative  for  the  lognormal  is  very 
closely  related  to  the  normal  cumulative  as  follows: 

F^j^(2|u,o)  = Fj^(ln(z)  |y,o)  . (2.16) 

Although  the  posterior  moments  of  the  multivariate 
lognormal  distribution  are  more  complicated  and  general 
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functions  of  tho  rovoalod  path  than  wgitg  thG  momGnts  for  the 
multivariatG  normal  distribution,  thG  flGxibility  is  about 
thG  samG.  ThG  assGSsmant  procGdurG  for  these  two  aistri- 
butions  would  be  very  similar.  There  is  only  one  functional 
form  for  the  posterior  moments  to  take;  and  once  this  form 
has  been  specified  for  the  posterior  median,  it  is  fixed 
for  the  posterior  mean  and  variance. 


2 . 4 The  Multivariate  Student  Distribution 


The  N-dimensional  multivariate  Student  distribution  is 
^ ter i 2 ed  bv  an  N”dimensional  vector  of  means  an 

NxN-dimensional  matrix  T,  and  a parameter  n,  usually 
called  the  degrees  of  freedom  of  the  distribution.  The 
density  function  has  the  form: 


{xlU  = fc”  T) 

_n+N 

T (2.17) 

= C (l+^(x-y) 'T  (x-y) ) 

_N 

„here  C = r |T|'*r(^  )-' (nir)  Note  that  the  matrix 

T is  very  similar  to  the  precision  matrix  of  the  multi- 
variate normal  distribution.  For  n>2  the  expected  value 
of  X and  the  covariance  matrix  of  x can  be  shown  to  be 
y and  respectively.  Thus  the  vector  y is  made 

up  of  the  expected  values  of  the  prior  distributions  of 
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Ji 


1 


x(i)  (i=l, 2, . . . ,N) . If 

x(i)  is  — ^ w. . where 
n-2  11 

row  and  the  ith  column  of 


W=T" 


W. 


, then  the  prior  variance  of 
is  the  element  in  the  ith 


In  order  to  examine  the  posterior  distributions  of  the 
multivariate  Student  distribution,  it  will  again  be  helpful 
to  partition  x,v£,T,  and  W.  Let 


x=  (x(l)  , . . . ,x(q)  |x(q+l)  , . . . ,x(N)  ) ' = (x^xM^ 
y = (y  (1)  , . . . ,y  (q)  [y  (q+1)  , . . . ,y  (N)  ) ' = (t  J ' 

(2.18) 


T 


where  T is  qxq, 
—1 1 


t 


W 


w w 

— 11  —12 

w w 

—21  —22 


where  W 
—1 1 


is  qxq. 

ns 


Note  that  W = T -T  T”'T  . The  posterior  distribution 
— 11  —11  —1  2—2  2—2  1 

x given  x^  can  be  shown  to  equal 


where  | > 

= y +W  W“^ (x  -y  ) 
-2  —2  1—11  —1  —1 


(2.19) 
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nnd 

II +q 

T = T — • 

I ' '■  nt  (x  -n  ) ' (T  -T  T-’T  ) (x  -u  ) 

—1  —1  ~1 1 —\7—7:~7\  ~I  ~1 

Soe  Appondix  C for  n {.iroof  of  this.  Note  tlia(  this  result 
nqreos  with  [10]  but  contradicts  (25].  Also  note  tlic 
similarity  betwonn  this  })ostorior  moan  and  t lio  [lostcrior 
moan  for  the  multivariate  normal.  Tlio  posterior  covariance 
matrix  is 


n+ (x  -n  ) ' (T  -T  T-'t  ) (x  -p  ) 
— \ ^1  —11  -~i  r ~r  7 ~r  1 ~i  ~ i 

n-t  q-2 


(2.20) 


n+ (x  -u  ) ' W“ ' (x  -P  ) 

— 1 — 1 11  ~i  ~i 

n+q-2 


(W  -W  W'W  ) 

~7  7 1 “I  1 “1  7 


wliich  is  a quadratic  function  of  tlie  l<nown  values  of  tlie  drv 

with  its  minimum  at  x = <x  Note  tliat  the  effect  of 

— 1 —1 

the  given  values  of  the  drv  x^  on  the  posterior  covariance 
matrix  is  a decreasing  function  of  n,  tlie  degrees  of  freedom 
In  fact  this  value  of  n can  be  used  to  adiust  tlie  curvature 
of  this  quadratic  function  as  shown  in  Figure  2.1.  However, 
since  tliere  is  only  one'  parameter  n,  we  cannot  adiust  tlie 
curvriturc  of  the  quadratic  functions  in  the  diffenuU,  peri- 
odic posterior  variance  expressions  independently.  Once  one 
curvature  is  adjusted,  all  of  the  others  are  also  determined. 
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The  implicit  assumption  of  the  multivariate  normal 
distribution  is  inherent  in  the  multivariate  Student  dis- 
tribution also.  That  is,  the  interaction  between  the  up- 
dated probability  distribution  on  x(i)  and  the  given  path, 

X (1) , X (2 ),..., X (i-1) , is  contained  in  the  off-diagonal 
elements  of  T.  These  off-diagonal  elements  are  closely 
related  to  the  correlation  coefficients. 

The  flexibility  of  the  multivariate  Student  distri- 
bution is  greater  than  that  of  the  normal  or  lognormal 
distributions  because  it  has  one  additional  parameter.  How- 
ever , this  increase  is  small  in  comparison  to  the  amount  of 

flexibility  we  would  like.  The  functional  forms  for  the 
posterior  mean  and  variance  in  terms  of  the  revealed  path 
are  still  fixed.  However > we  can  now  make  a small  adjustment 
to  all  of  the  posterior  variances,  independently  of  the 
posterior  means.  But  we  would  also  like  to  have  some  choice 
over  the  functional  forms  as  well. 


31 


CHAPTER  3 


THE  METHOD  FOR  UPDATING  THE  PRIOR  DISTRIBUTIONS 


3.1  Introduction 


In  this  chapter  the  method  for  approximating  the 
decision  maker's  joint  probability  distribution  on  an 
evolving  dynamic  uncertain  process  is  developed.  Ideally 
this  method  will  have  the  following  attributes:  the 
flexibility  to  produce  a very  close  approximation  of  the 
decision  maker's  joint  probability  distribution  on  a drv 
and  an  easily  assessible  form.  Conceptually,  our  goal 
is  to  model  how  the  decision  maker  updates  his  prior  dis- 
tribution on  x(i)  to  yield  his  posterior  distribution 
given  the  values  of  x(l) ,x (2) , . . . ,x  (i-1)  (i=2 , 3 , . . . N) . 
In  other  words  we  want  to  model  how  the  decision  maker 
uses  th  values  of  x (1) , x (2) , . . . , x (i-1 ) to  transform 
his  prior  distribution  on  x(i)  into  his  posterior 
distribution  on  x(i).  This  is  illustrated  in  Figure 
3.1.  This  method  is  basically  a two  point  updating  rodel 
that  has  enough  generality  to  be  applied  in  several 
possible  ways.  An  example  of  one  other  application  is 
discussed  in  the  next  section.  If  this  process  can  be 
successfully  modeled,  then  only  N prior  distributions 
and  a reasonable  number  of  posterior  distributions  must 
be  encoded. 
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A general  description  of  the  method  develop'd  in  this 
chapter  is  the  following;  First,  the  N prior  probability 
distributions,  one  for  the  value  of  the  drv  in  each  time 
period,  are  assessed.  Then  these  prior  distributions  are 
approximated  by  some  family  of  continuous  probability  dis- 
tributions, such  as  the  normal  distribution.  An  updating 
algorithm  is  then  specified  for  calculating  the  posterior 
distribution  of  the  drv  in  period  i given  the  values  of 
the  drv  in  periods  one  through  i-1.  These  posterior 
probability  distributions  are  assumed  to  be  in  the  same 
general  family  as  the  prior  distributions.  Additional 
information  beyond  the  N prior  distributions  will  be 
needed  from  the  expert  to  specify  and  parameterize  this 
updating  algorithm  for  the  drv.  This  information  will  take 
the  form  of  assessed  posterior  probability  distributions. 

3.2  The  Method 


The  basis  of  this  method  is  a model  of  the  decision 
maker's  algorithm  for  updating  his  prior  distribution  on 
x(i),  {x(i)|Of  into  his  posterior,  {x  (i ) | x (i-1)  , . . . , x (1 ) , C } 
for  any  revealed  path;  x (1) ^ , x (2 ) ^ , . . . , x ( i-1 ) ^ . Since  all 
of  our  assessment  techniques  yield  cumulative  distributions, 
this  method  is  based  on  updating  the  decision  maker's  prior 
cumulative  to  his  posterior  cumulative.  For  a discussion  of 
probability  assessment  see  [28].  Once  the  N priors  and  an 


updating  algorithm  for  each  time  period  are  obtc'ined  the 
N probability  distributions  that  uniquely  determine  the 
joint  distributions  can  be  specified.  These  N distri- 
butions are: 

{x(l)  lU 
{x(2)  |x(l) 


{x(i)  |x(i-l),...,x(l),?} 


{x(N)  Ix(N-l)  , . . . ,x(l)  ,U. 

There  are  two  major  advantages  to  this  approach.  The 
first  is  that  these  are  the  N distributions  needed  for 
the  decision  analysis.  Since  our  success  will  be  deter- 
mined by  how  well  these  distributions  are  approximated, 
we  should  concentrate  our  efforts  on  them.  Second,  the 
joint  distribution  will  usually  be  much  more  intractable 
mathematically  than  will  the  above  N distributions. 

So  these  N distributions  should  be  easier  to  approxi- 
mate . 
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However,  this  method  is  still  not  practical. 

First,  it  is  not  practical  to  develop  separate  models 
of  the  decision  maker's  updating  process  for  periods 
two  through  N.  This  would  require  too  many  assessments 
of  the  decision  maker  and  too  much  analytic  effort  of 
the  analyst.  For  decision  analyses  that  have  been 
adequately  modeled  we  have  found  that  a recursive  model 
of  the  updating  algorithm  provides  a decent  approximation. 
That  is,  a model  can  be  specified  for  period  i in  general. 
There  are  cases  where  a subset  of  the  parameters  of  this 
recursive  model  are  functions  of  the  period  i.  This 
complication  can  be  handled  easily  though  and  will 
be  discussed  in  the  next  chapter.  More  will  be  said 
later  about  this  simplification  and  what  can  be  done 
to  achieve  it. 

Designing  a model  for  updating  an  entire  prior  dis- 
tribution into  a posterior  is  also  too  difficult  to 
accomplish  practically.  For  this  reason  prior  and 
posterior  distributions  are  approximated  by  members  of 
the  same  family  of  named  distributions.  For  the 
remainder  of  this  section  all  of  the  decision  maker's 
prior  and  posterior  distributions  are  assumed  to  be 
normal  distributions.  The  normal  family  has  mathematical, 
practical,  and  explanatory  advantages.  The  ability  of 
this  method  to  be  used  with  other  families  of  named  dis- 
tributions is  explored  in  the  next  section.  The  advantage 
of  this  assumption  is  that  a named  distribution  is 


36 


'I 


completely  characterized  by  two  parameters.  Therefore 
only  two  points  of  the  decision  maker's  updating  process 
must  be  modeled.  The  parameters  of  a named  distribution 
can  be  calculated  from  any  two  points  on  its  cumulative. 
This  is  indeed  a great  savings  as  well  as  a great  simpli- 
fication over  specifying  the  updating  process  for  every 
point  of  the  distribution. 

A final  simplification  is  necessary  before  this  method 

is  presented  in  detail.  This  simplification  is  motivated 

by  the  assumption  that  the  generating  process  of  the 

drv  is  nonstationary  as  well  as  by  the  limitations  on 

human  probability  assessments.  A major  characteristic 

of  nonstationary  processes  is  that  the  more  recent  the 

information,  the  more  valuable  it  is  for  making  inferences 

about  that  process.  Therefore,  when  the  decision  maker 

is  updating  his  prior  distribution  on  x(i)  with  the 

revealed  path  x(l)  , x ( 2 ).,..., x (i-1 ), , the  value  of 

(p  4>  v 

x(i-l)  will  be  the  most  influential,  the  value  of  x(i-2) 
the  second  most  influential,  etc.  In  fact,  there  will  be 
some  period,  i-  8,-1 , in  which  the  value  will  not  really 
affect  his  assessment  of  this  posterior  distribution 

given  the  more  recent  information  x(i-  8 ),,..., x ( i-1) ^ . 

(}) 

The  implication  of  this  is  the  following: 
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{x(i)  |x(i-l)  , . . . ,x(i-jl)  , . . . ,X(1)  ,C}  = 

{x(i)  I x(i-l x(i-£),U.  (3.1) 

This  type  of  probabilistic  independence  will  be  called 
conditional  independence,  and  the  order  of  conditional 
independence  will  then  be  the  value  I for  which  this 
equation  holds.  Typically  the  order  of  conditional  inde- 
pencence  will  be  independent  of  the  value  of  i for  a given 
drv.  It  has  ranged  between  one  and  three  for  the  assess- 
ments we  have  done.  The  impact  of  this  concept  is  that  the 
updating  model  for  period  i will  now  only  have  to  be  a 
function  of  x (i-1) ^, . . . ,x  (i-£) ^ rather  than 
x(i-£)^,...,x(l)^. 

There  are  still  many  possible  ways  to  model  the  decision 
maker's  updating  process  given  the  above  set  of  assumptions. 
The  method  that  we  have  found  to  work  best  is  not  the  most 
obvious,  and  reasons  for  choosing  the  modeling  approach 
will  be  presented  as  the  discussion  proceeds.  The  most 
obvious  point  on  a cumulative  to  update  is  the  median  or  0.5 
fractile.  The  median,  which  is  equal  to  the  mean  for  the 
normal  distribution,  is  the  measure  of  a distribution's 
central  tendency  that  is  always  assessed.  In  fact  it  is  the 
easiest  point  of  any  distribution  to  assess.  The  most 
natural  way  to  model  the  updating  of  the  median  in  period 
i is  to  model  the  horizontal  arrow  in  Figure  3.2  as  a 
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{ X ( i ) <_x  I ^ } 


Figure  3.2.  A graphical  representation  of  the  median  updating  algorithm 


r 


function  of  the  revealed  path,  x (i-1) , . . . ,x (i-£) . The 
single-weight  curve  is  the  prior  cumulative  of  x(i),  and 
the  double-weight  curve  the  posterior.  The  horizontal  arrow 
represents  a distance  and  a direction  that  is  the  difference 
between  the  posterior  and  prior  medians.  It  is  measured  in 
units  of  the  drv.  However,  we  have  found  that  modeling  in 
value-space  (x-space) , as  would  be  done  with  this  horizontal 
arrow,  does  not  always  produce  the  robust  model  we  need  in 
terms  of  being  recursive  for  each  period  i.  This  is 
especially  true  of  the  second  point  to  be  modeled. 

Rather-  modeling  the  length  of  the  vertical  arrow  in 
Figure  3.2  has  been  found  to  provide  a very  robust  and 
accurate  description  of  the  decision  maker's  updating 
process.  This  vertical  distance  is  interpreted  as  the  delta 
in  fractile  units  that  must  be  added  to  or  subtracted  from 
0.5  to  find  the  fractile  on  the  prior  cumulative  that  is 
direct.ly  above  or  below,  respectively,  the  posterior  median. 
It  can  also  be  interpreted  as  the  vertical  distance  from  the 
posterior  median  to  the  prior  cumulative,  where  up  is  the 
positive  direction.  This  arrow  will  be  referred  to  as  g^  ^ 
and  is  in  fractile  space  (f-space) . Mathematically,  this  is 
written  as: 


X (i I i-1) 


= X (i  U) 


5+g 


(3.2) 
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The  equation  for  the  posterior  median  in  terms  of  the 
prior  distribution  and  g is: 

0 . 5 


x(i  |i-l) 

0 . 5 


F-M0.5+g^  Jx(iU) 


(3.3) 


where  ^x(i|0  ~ prior  standard  deviation  of  x(i). 
Solving  for  g 

0 . 5 


g 


0 . 


5 


x(ili-l)  -xdjO 

0.5  0.5 

0.1 

^x(iU) 

J 

0.5. 


(3.4) 


That  is,  g can  be  calculated  from  the  posterior  median, 

0.5 

the  prior  median,  and  the  prior  standard  deviation.  One 
reason  why  this  modeling  strategy  is  successful  is  that  the 
paths  through  time  of  the  drv  defined  by  a constant  prior 
fractile  (such  as  the  path  of  prior  medians)  are  generally 
considered  more  lilcely  than  other  possible  paths.  A 
second  reason  is  that  this  updating  model  is  defined  in 
terms  of  the  decision  ma)cer's  probabilistic  beliefs. 

The  first  aspect  of  g to  note  is  that  it  is 

0,5 

bounded  above  and  below  by  0.5  because  probabilities  are 
restricted  to  lie  between  0.0  and  1.0.  This  is  a limitation 
in  the  sense  that  the  analyst  must  be  careful  that  his 
model  observes  these  constraints.  However,  we  have  also 
found  that  the  constraints  can  be  useful  in  defining 
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the  updating  algorithm.  This  will  be  discussed  in  Chapter 

4. 


Second,  g is  a function  of  i,  x ( i-1)  , . . . , x ( i-S. ) : 

0.5 

g = g (i,x(i-l) , . . . ,x(i-£) ) . (3.5) 

0.5  0.5 

Remember  that  i is  an  argument  of  g ^jven  though  it 

0^5 

is  a recursive  function.  That  is,  the  functional  form 
will  rarely  be  a function  of  i,  but  some  of  the  parameters 
may.  Experience  has  shown  that  just  as  the  median  up- 
dating model  constructed  in  x-space  was  not  as  robust  as 
the  one  in  f-space,  having  the  arguments  of  the  revealed 
path  in  f-space  yields  a more  robust  model  than  having  them 
in  x-space.  To  accomplish  this  ( 3 ) jj,  is  transformed 
to  its  corresponding  prior  fractile  f(j)  using  the 
assessed  prior  distributions: 

f (j)  = {x(j)<x(j)^tC}-  (3.6) 

Therefore  the  final  functional  formulation  of  g is: 

0 . 5 

g =g  (i,f  (i-1)  , . . . ,f  (i-^.)  ) . (3.7) 

It  should  be  noted  here  that  no  closed-form  expression 
exists  for  the  normal  cumulative,  and  therefore  for  its 
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fractiles.  However  the  cumulative  of  the  standardized 
normal  distribution,  F^(x|0,l),  and  its  inverse  can  be 
calculated  to  great  accuracy  on  most  computers  using  either 
the  "error  function"  library  program  or  one  of  the  approx- 
imations discussed  in  [8], 

Before  discussing  the  updating  of  the  second  point 
on  the  prior  cumulative,  it  should  be  pointed  out  that 
the  median  updating  model  can  be  interpreted  as  a first 
approximation  of  the  decision  maker's  total  updating 
process,  g ^ defines  a horizontal  translation  from  the 
prior  median  to  the  posterior  median.  We  could  in  fact 
translate  the  entire  prior  distribution  by  this  horizontal 
distance.  The  result  would  be  a normal  distribution  with 
the  posterior  median  and  the  prior  variance.  This  trans- 
lation is  shown  in  Figure  3.3  as  the  dotted  cumulative. 


The  approximation  of  the  posterior  distribution  could 
be  completed  by  updating  any  other  fractile,  say  0.9,  as 
was  done  above  for  the  median.  That  is,  we  could  construct 
a model  of  g ss  shown  in  Figure  3.4; 

0 . 9 

q = g (i,f  (i-l,...,f  (i-Jt))-  (3.8) 

^0.9  0.9 

The  equation  for  the  posterior  0.9  fractile  is: 


x(i|i-l)  = , 

' 0.9  “ 0,9 
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{x(i)^x!^} 


1 


Solving  for 


where  y = the  standardized  normal  variate,  fj^(y|0fl) 

c = the  posterior  standard  deviation  of 

X (i 1 i-1) 

x(i)  given  the  values  of 
x(l)  , ••  • ,x(i—l)  • 

However,  this  approach  was  not  successful  in  practice.  VVhile 
a decent  approximation  of  the  posterior  0.9  fractile  could 
be  obtained,  the  resulting  approximate  posterior  variance 
was  often  far  from  the  decision  maker's  posterior  variance, 
which  was  calculated  from  his  assessed  distribution.  The 
reason  for  this  is  that  when  the  approximate  posterior 
median  was  less  (greater)  than  the  assessed  median,  and  the 
approximate  posterior  0.9  fractile  greater  (less)  than  its 
assessed  counterpart,  the  approximate  variance  was  much  too 
large  (small).  The  result  is  large  errors  for  other  frac- 
tiles  of  the  posterior  distribution.  (Actually  we  could  use 
this  approach  to  update  every  prior  fractile  by  building  a 


0 , 9 


^ F. 


n 


X (i  I i-1)  -X (i I O „ ^ 

' 0 9 0.5 


’x(i  O 


0,1 


- 0.9 


^ F 


n 


-X  (i  I O 


0 . 5 


’x(iU) 


0,1 


- 0.9 
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model  that  not  only  had  i,f  (i-1)  , . . . ,f  (i-Jl)  as  arguments 
but  f,  the  fractile  spectrum  of  the  posterior  distribution, 
as  well.  Here  the  range  of  f would  be  the  interval  be- 
tween 0.0  and  1.0.  This  formulation  of  a joint  probability 
distribution  has  some  interesting  properties,  and  the 
results  are  presented  in  Appendix  D. ) 

A different  application  of  this  general  two-point 
updating  approach  is  to  a bidding  situation.  When  a decision 
maker  is  making  sequential  bidding  decisions  with  a uniform 
group  of  competitors,  he  would  like  to  have  a procedure  for 
updating  his  uncertainty  on  the  winning  bid.  In  such  a case 
the  0.9  to  0.99  fractile  range  of  his  posterior  distribution 
is  critical.  This  method  could  be  used  to  update  the  0.9 
and  0.99  fractiles  as  discussed  in  the  preceding  paragraph. 
This  would  result  in  an  accurate  approximation  of  the  decision 
maker's  posterior  distribution  in  the  region  of  interest. 

Since  the  median  updating  model  defines  a translation 
of  the  prior  cumulative,  the  second  updating  model  should  be 
directed  at  rotating  the  prior  cumulative  to  the  standard 
deviation  of  the  posterior  distribution.  This  can  be  done 
by  modifying  g slightly  with  the  assumption  that  the 

0 . 9 

prior  and  posterior  medians  are  the  same.  Equation  3.10  now 
reduces  to 
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g*o  9 = F 


^0. 9 ^x(i|i-l) 

^x(iIU 


0,1 


-0.9.  (3.11) 


The  posterior  standard  deviation  is  then 


^(i|i-i)  = f;;Mo.9  + g*  |o,i) 

y 

0 . 9 


0 . 9 


F->(0.9+g*  |0,1) 

“ 0.9 


f-Mo.9  |0,1) 


"xiiln. 


Just  as  the  median  updating  model  could  be  considered  a 
first  approximation  of  the  decision  maker's  updating 
process  by  translating  the  prior  distribution  to  the 
posterior  median,  the  standard  deviation  updating  model 
can  be  interpreted  as  a second  approximation.  It  is  in 
fact  a rotation  of  the  prior  distribution  about  the  prior 
median  to  a distribution  with  the  posterior  standard 
deviation.  This  is  shown  in  Figure  3.5.  The  dotted  line 
represents  the  rotated  distribution  with  the  distance 
9*0.9  labeled.  9* 0.9  is  then  the  vertical  distance  from 
the  prior  0.9  fractile  to  the  rotated  posterior  distribu- 
tion with  the  prior  median.  Again,  up  is  the  positive 
direction . 


Just  as  gp_5  is  bounded  above  and  below  by  0.5, 
g*Q  g also  has  constraints: 
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Figur 


r 


-0.4<g*  <0.1.  (3.13) 

0 . 9 

Actually,  any  fractile  other  than  0.5  could  be  chosen  for  the 
standard  deviation  updating  model.  In  practice  we  have  used 
the  0.7,  0.75  and  0.9  fractiles  with  equally  satisfactory 
results.  The  constraints  for  g|(f>0.5)  are: 

f-0. 5<g*<l. 0-f.  (3.14) 

It  should  also  be  noted  that  when  the  posterior  variance  is 
less  (greater)  than  the  prior  variance,  g*  is  less 

0 . 9 

(greater)  than  zero. 

3 . 3 Relaxing  the  Assumption  of  Normal  Distributions 

Clearly  , this  method  would  be  very  limited  if  the  prior 
and  posterior  distributions  could  only  be  approximated  by 
normal  distributions.  The  flexibility  to  approximate 
adequately  the  uniform,  exponential,  and  unimodal  symmetric 
and  s)cewed  distributions  shown  in  Figure  3.6  must  exist  if 
this  method  is  to  be  useful.  Both  prior  and  posterior 
distributions  may  assume  these  shapes.  Non-unimodal  distri- 
butions are  not  considered  because  their  occurrence  indicates 
the  need  for  more  modeling. 
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It  should  be  pointed  out  here  that  all  of  the 
posterior  distributions  need  not  be  members  of  the 
same  family  of  named  distributions.  It  is  only  neces- 
sary that  all  of  the  posterior  distributions  for  a given 
period  be  members  of  the  same  family.  However^  in  order 
for  g 5 . 5 and  9 * 9 to  be  recursive  all  of  the 
prior  distributions  must  be  members  of  the  same  family. 

If  the  drv  is  adequately  modeled  as  mentioned  before, 
these  restrictions  should  not  be  a major  problem.  It 
was  not  a serious  problem  for  the  assessments  we  did. 

In  order  to  develop  succinctly  equations  for  the  other 
families  of  named  distributions,  we  will  assume  that  all 
of  the  prior  and  posterior  distributions  are  members 
of  the  same  family  for  the  rest  of  this  section. 

If  the  family  of  uniform  distributions  (Figure  3.6(a)) 
is  the  best  approximation  of  the  assessed  distributions, 
this  method  can  certainly  be  used.  However,  building 
a model  of  the  posterior  end  points  of  the  uniform  distri- 
bution as  a function  of  the  revealed  path  would  be 
a more  direct,  intuitive  and  rewarding  approach. 

Next,  the  exponential  distribution  (Figure  3.6(b)) 
is  perhaps  the  easiest  family  to  use  with  this  method 
because  it  has  only  one  parameter.  The  exponential 
distribution  has  the  following  density  function  and 
characteristics : 
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{xIU  = fe(x|X)  = Aexp  [-Xx],  x>0,  (3.15(a)) 

X = ln(2)  (\)~\  (3.15(b)  ) 

0 . 5 

{x<x^iU  = Fg(x|X)  = l.O-exp(-Xx^)  . (3.15(c)) 

Note  that  the  parameter  is  directly  related  to  the  median. 

Only  the  median  updating  algorithm  of  the  decision 
maker  must  be  modeled  for  this  distribution.  The  posterior 
median  is: 


x(i|i-l)  = f:'  (0.5+g  |X(ilC)) 

0.5  e 0,5 

= -(X  (i|Oln(0.5-g  ) )”^ 

0,5 


(3.16) 


Therefore  g is 

0 . 5 


0 . 5-exp 


5 



X (i I i-1) 


1 

ln(0.5)  ' . 

J 


(3.17) 


For  symmetric  posterior  distributions  (Figure  3.6(c)) 
the  normal  family  will  often  yield  an  acceptable  approxi- 
mation of  the  assessed  distributions.  Actually  , many  skewed 
distributions  can  be  adequately  approximated  by  the  normal 
distribution.  In  fact  all  of  our  assessm.ents  were  in  this 
category. 
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Finally,  for  the  skewed  distribution  shown  ii.  Figure 
3.6(d)  the  lognormal  family  of  .listributious  provides  the 
most  reasonable  approximation  tor  this  method.  The  ether 
families  for  approximating  skewed  distributions  are  the 
gamma,  Weibull,  Fisher,  and  inverse  Gaussain  (Wald).  There 
are  two  general  characteristics  of  a distribution  that  are 
important  in  maintaining  a simple  model  of  the  updating 
algorithm.  These  are  the  complexity  of  the  distribution's 
cumulative,  which  is  the  equation  for  the  fractiles,  and  the 
relationship  between  the  parameters  of  the  distribution  and 
its  median  and  variance.  Of  the  five  families  of  the  distri- 
butions mentioned  above  only  two  have  a closed-form  relation- 
ship between  their  median  and  their  parameters,  the  lognormal 
and  Weibull.  The  median  of  the  gamma  distribution  can  be 
approximated  by  several  different  functions;  however,  all  of 
these  functions  are  very  cumbersome  for  sufficiently  accurate 
approximations.  Thus  we  can  eliminate  three  families.  The 
relationship  between  the  variances  of  the  remaining  two 
distributions  and  their  parameters  are  also  closed-form 
expressions.  However  , the  variance  of  the  Weibull  distribution, 


is  a very  complex  function  of  the  parameters  a and  p.  In 
fact,  it  would  require  an  iterative  approach  to  calculate 
the  parameters  of  this  distribution  given  its  median, 
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1 

(ln(2)/a)^,  and  variance.  Therefore  we  are  left  with  the 
lognormal  distribution.  Unfortunately,  no  closed-form 
expression  exists  for  the  cumulative  of  the  iPgnormal 
distribution,  just  as  for  the  normal  distribution.  However, 
the  cumulative  of  the  lognormal  distribution  is  a function 
of  the  normal  cuniulative  (see  Chapter  2.3): 


Fj_^(x|y,a) 


F 


n 


In  (x)  ~\i 


a 


(3.19) 


Therefore  the  equations  of  the  previous  section  for  the 
normal  family  can  be  derived  for  the  lognormal  family.  The 
lognormal  distribution  was  discussed  in  Chapter  2.3.  As  a 
review,  the  following  information  is  presented: 


{x|c}  = f^j^(x|p,a) 


(3.20(a) ) 


= ax(2Tr) 


exp 


ln(x) 


X = exp(y) 

0 . 5 

<x|^>  = exp(y+i5a) 

<xlc>  = exp (2y+a) (exp (a) -1 . 0) 
= <x I (exp (a) -1 .0) . 


(3.20(b) ) 
(3.20(c) ) 
(3.20(d) ) 


For  the  lognormal  family  the  equation  for  the  posterior 
median  is 
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x(i|i-l)  = F:'(0.5+g  |y(iU)  ,a(i|c))  (3.21) 

0.5  In  0.5' 

= x(i|U  (exp(a  (iU)F-M0.5+g  |0,1))) 

0 5 n 0 5 


where  y (i | ^ ) 
a(i|^) 


ln(x(i|U  ) 

0.5 

2(ln(<x(i)  U>)-y(iU)) 


In 


x(iU) 

1+  

<x{iU)>' 


For  a proof  of  this,  see  Appendix  E.  Solving  for  9^  5 
get 


g = F 

^0.5  n 


^x(i|i-l) 

ln| ! |0,1 


i X ( i U ) 


0 . 5 


- 0.5.  (3.22) 


However  , the  solution  for  the  posterior  standard  devia- 
tion must  be  done  differently  for  the  lognormal  family. 

First  the  updated  0.9  fractile  must  be  found  under  the 
assumption  that  the  prior  and  posterior  medians  are  equal. 
This  assumption  will  be  denoted  by  the  state  of  information 


X (i \jd*) 


9 


F^^(0.9+g*  ^ ly  (i| O f a(i|C) ) (3.23) 

x(i|0  (exp  (a  (i  I O F'Mo . 9+g*  |0,1))). 

0.5  n 0.9 


56 


Next  a relationship  between  the  f fractile  of  a lognormal 
distribution  and  its  parameters  must  be  used.  This  relation- 
ship is  proven  in  [1]  . 


Xj  = exp  (y+oF“Mf  I 0 , 1) ) . 


(3.24) 


Therefore 


a (i 1 i-1) 


ln(x(i|^*)^  ^)-}i(i|U 


(3.25) 


The  equation  for  g*  is  found  by  manipulating  equation 

0,9 

3.23; 


= F. 


0 . 9 


n 


a (i I i-1) 

^ ® a (i  5) 


0,1 


- 0.9, 


(3.26) 


The  y and  a parameters  have  now  been  updated  so  the 
posterior  mean  and  variance  can  also  be  calculated. 


3 . 4 Sources  of  Error 

In  this  section  the  components  of  error  for  this 
approximation  technique  are  examined.  There  are  four 
components:  assessment  error,  named  distribution  error, 
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curve-fitting  error,  and  interpolation  error.  The  assess- 
ment error  exists  because  the  decision  maker  cannot  be 
completely  accurate  in  the  expression  of  his  probabilistic 
beliefs.  This  research  has  not  addressed  the  problem  of 
reducing  this  type  of  error,  which  has  been  investigated 
elsewhere  [28,29]. 

The  second  component  of  error  results  from  assuming 
that  all  the  posterior  distributions  are  members  of  the  same 
family  of  named  distributions.  The  purpose  of  the  previous 
section  is  to  provide  the  flexibility  for  this  method  so 
that  this  component  of  error  is  within  the  acceptable  region. 
It  was  not  a problem  in  our  assessments,  and  none  of  the 
individuals  who  provided  the  probabilistic  information 
expressed  concern  over  this  approximation. 

The  third  type  of  error  results  when  we  approximate  g^  ^ 

and  q*  with  the  information  contained  in  a number  of 
0.9 

posterior  distributions.  The  procedure  for  doing  this  is 
discussed  in  the  next  chapter.  Clearly,  this  error  is  a 
decreasing  function  of  the  number  of  posterior  distributions 
we  use.  However,  posterior  distributions  are  not  free  so 
the  analyst  must  make  a trade-off  between  this  error  and  the 
number  of  posterior  distributions  he  assesses.  We  have 
found  in  doing  our  assessments  that  this  error  could  be  held 
to  a reasonable  level  with  12  to  18  posterior  distributions. 


58 


More  posterior  distributions  are  generally  needed  when  the 
updating  algorithms  are  functions  of  time  or  nonlinear 
functions  of  the  revealed  path.  This  error  can  be  reduced 
to  zero  by  introducing  as  many  parameters  into  g^  ^ and  g*  ^ 
as  there  are  data  points.  However,  it  is  often  important  to 
balance  the  simplicity  of  the  model  against  the  reduction  of 
this  curve-fitting  error  when  the  simple  model  will  do  just 
as  well  for  the  purpose  at  hand.  That  is,  adding  additional 
terms  to  g and  g*  to  reduce  the  curve-fitting  error 

0.5  "’0.9 

to  zero  is  not  justified  if  the  fourth  element  of  error 
(interpolation)  is  unaffected  by  the  additions.  Also,  part 
of  this  curve-fitting  error  results  from  the  assessment 
error  of  the  decision  maker. 

Interpolation  error  results  when  we  use  posterior 
distributions  in  the  decision  analysis  that  were  not  assessed 
but  calculated  by  the  approximation  technique.  This  error 
is  present  primarily  because  this  specification  of  the 
decision  maker's  joint  probability  distribution  is  an 
approximation.  If  there  were  a "true"  g and  g^  and 
we  assessed  enough  posterior  distributions  to  specify  them, 
then  the  interpolation  error  would  be  zero.  Therefore,  the 
only  way  that  this  error  can  be  influenced  is  by  having  an 
updating  algorithm  that  is  a very  close  representation  of 
the  decision  maker's  mental  process.  So  it  is  much  more 
important  to  have  a few  terms  in  each  of  9 9*  ^ 
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that  reflect  the  decision  maker's  updating  process  than  to 
have  a lot  of  terms  that  only  reduce  the  curve-fitting  error 
to  zero. 
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CHAPTER  4 


THE  ASSESSMENT  PROCEDURE  FOR  THE  METHOD 
OF  UPDATING  THE  PRIOR  DISTRIBUTIONS 


4.1  Introduction 


The  assesment  procedure  for  the  method  of  updating  the 
prior  distributions  has  five  phases:  two  for  assessment 
two  for  analysis,  and  a verification  phase.  This  procedure 
is  illustrated  by  a flowchart  in  Figure  4.1. 

The  decision  analyst  will  assess  the  N prior  distri- 
butions and  gather  information  that  will  enable  him  to 
construct  preliminary  models  of  the  decision  maker's  up- 
dating algorithm  in  the  preliminary  assessment  phase. 

The  analyst  will  then  construct  these  models  and  approximate 
the  prior  distributions  with  the  appropriate  named  distri- 
butions in  the  preliminary  analysis  phase.  The  final  assess- 
ment phase  will  be  devoted  to  the  assessment  of  posterior 
distributions  that  will  enable  the  analyst  to  complete  the 
models  of  the  decision  maker's  updating  process  in  the  final 
analysis  phase.  The  last  phase  will  be  the  verification  of 
the  updating  models  for  use  in  the  decision  analysis  by  the 
decision  maker.  These  five  phases  will  be  discussed  sequen- 
tially in  the  next  five  sections  of  this  chapter. 
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4 . 2 The  Preliminary  Assessment  Phase 


The  preliminary  assessment  phase  has  several  purposes. 
The  first  purpose  is  to  complete  the  first  three  steps  of 
the  Spetzler  and  Stael  von  Holstein  [28]  encoding  interview. 
These  are  the  motivating,  structuring,  and  conditioning 
steps.  After  accomplishing  this  initial  phase  by  asking 
questions  about  the  drv  that  are  analgous  to  those  for  a 
random  variable,  the  decision  maker  should  be  asked  to 
quantify  his  thoughts  in  the  form  of  N prior  distributions 
on  the  drv,  {x(i)|0-  Each  of  these  distributions  should 
be  assessed  carefully  and  verified  afterwards  because  they 
form  the  foundation  of  this  method. 

Next,  the  analyst  should  obtain  the  information  that 
will  allow  him  to  construct  preliminary  versions  of  g 

0.  5 

and  g*  . The  first  item  to  question  the  decision  maker 

0 . 9 

about  is  the  order  of  conditional  independence.  The  analyst 
should  decrease  the  value  of  k,  beginning  at  one,  until  the 
decision  maker  says  that  variations  in  the  value  of  x(N-k) 
do  not  affect  his  posterior  distribution 

{x(N)  I X (N-1 ),..., X (N-k ), O . This  should  also  be  done  for 
one  or  two  other  values  of  i.  Usually  k will  be  the  same 
in  each  instance  and  Ji=k-1  is  the  order  of  conditional 
independence . 
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The  analyst  should  next  ask  the  decision  maker  to  graph 
the  posterior  median  of  x{i)  given  the  value  of  x(i-l) 
versus  the  value  of  x(i-l),  for  several  values  of  i.  An 
example  of  this  is  shown  by  the  solid  line  in  Figure  4.2. 

To  speed  up  the  assessment  process,  the  decision  maker  should 
not  be  held  responsible  for  believing  every  point  on  the 
graphs.  However,  several  points  on  each  should  be  checked  to 
make  sure  that  he  believes  the  general  shape  of  the  curves. 
The  analyst  should  determine  if  the  same  general  form  is 
implied  for  each  value  of  i.  If  not,  then  he  should  ask 
the  decision  maker  why  the  graphs  are  different.  The  only 
reason  for  such  a difference  that  we  have  encountered  is 
that  a future  uncertain  event  has  a major  effect  on  the 
decision  maker's  updating  process.  By  making  the  drv 
conditional  on  the  outcome  of  this  event,  this  problem  can 
be  alleviated.  This  is  discussed  in  greater  detail  in 
Chapter  5,3. 

Other  useful  information  would  be  several  graphs  of  the 
posterior  variance  of  x{i)  given  the  value  of  x(i-l) 
versus  the  value  of  x(i-l).  If  the  decision  maker  has 
trouble  thinking  in  terms  of  the  variance,  then  some  surro- 
gate should  be  used.  Examples  are  the  standard  deviation  or 
"spread  of  the  distribution."  Since  this  is  a difficult 
concept  to  think  about  (even  for  someone  trained  in  proba- 
bility theory) , the  decision  maker  should  not  be  held 
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responsible  for  any  of  the  points  on  this  curve,  but  onl/ 
for  its  general  shape.  These  graphs  will  be  used  to  help 
determine  g*  i so  they  should  all  have  similar  shapes. 

Finally!  the  decision  maker  should  be  asked  to  describe 
in  general  terms  what  the  effect  of  interactions  between 
X (i-1)  , . . . ,x(i- 2.)  will  be  on  the  posterior  distribution  of 
x(i),  {x(i)  |x(i-l)  , . . . ,x(i-2)  ,0.  A particularly  helpful 

method  that  the  analyst  can  use  is  to  ask  the  decision  maker 
how  his  graphs  of  the  posterior  median  x(i|i-l)^  ^ and 

V 

variance  x(i|i-l)  versus  x(i-l)  change  for  several 
values  of  x(i-2).  The  0.25,  0.5,  and  0.75  prior  fractiles 
of  x(i-2)  will  provide  sufficient  information.  This 
information  can  then  be  plotted  on  these  original  graphs  as 
shown  by  the  dotted  lines  in  Figure  4.2. 

A flowchart  for  this  first  phase  of  the  assessment 
procedure  is  presented  in  Figure  4.3 

4 . 3 The  Preliminary  Analysis  Phase 

There  are  three  steps  in  this  phase  of  the  assessment 
procedure.  The  first  is  to  approximate  the  prior  distri- 
butions which  were  assessed  in  the  previous  phase  by  mtmoers 
of  the  appropriate  family  of  named  distributions.  Two 
different  methods  for  deriving  this  approximation  will  be 
described  here.  The  first  is  probably  not  quite  as  accurate 
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Figure  4.3.  The  preliminary  assessment  phase 


as  the  second  but  is  less  work.  It  involves  estimating  the 
parameters  directly  from  the  assessed  cumulatives.  For  the 
normal  distribution  the  two  parameters  correspond  to  the 
median  (mean)  and  standard  deviation.  So  for  each  prior 
distribution  the  median  has  been  assessed.  The  standard 
deviation  can  be  approximated  by  rewriting  the  definition  of 
standardized  normal  variate: 


S 


X 


0 = 


(4.1) 


where  a 7^  0.5.  The  average  of  a calculated  this  way  for 
several  values  of  a should  yield  a good  approximation  of 
the  prior  normal  standard  deviation. 

The  exponential  distribution  can  be  approximated  di- 
rectly from  the  assessed  median  by  using  equation  3.15(b) . 


The  prior  parameters  of  the  lognormal  distribution  are 
best  approximated  by  the  assessed  median  and  mean.  The  mean 
can  be  determined  graphically.  See  [13]  for  a discussion 
of  this  graphical  technique.  Then 


y(i|C)=ln(x(i|C)^^)  (4.2) 

0(i|^)  = 2 [In  (<x  (i)  K>)  - y(iU)].  (4.3) 


69 


However  , a more  refined  method  for  calculating  these 
parameters  is  least  squares.  See  [22,26]  for  a discussion 
of  least  squares.  For  each  of  these  distributions  there  is 
a linear  equation  relating  the  parameters  and  fractiles  of 
the  distribution: 

y + y^a  = (normal)  (4.4(a)) 

y ^ “ In(x^)  (lognormal)  (4.4(b)) 

X = -(x^)"^  In(l.O-f).  (exponential)  (4.4(c)) 

Each  point  that  the  analyst  assessed  on  a given  cumulative 
can  be  translated  into  an  equation  to  be  used  in  the  least 
squares  estimation  of  the  parameters  of  that  prior  distri- 
bution . 

The  next  step  is  to  specify  preliminary  forms  for  g^  ^ 
and  Q*  by  using  the  information  obtained  in  the  previous 

phase.  For  the  remainder  of  this  chapter  we  will  assume 
that  the  order  of  conditional  independence  is  two.  This  was 
the  most  frequent  value  for  the  assessments  we  did.  The 
procedure  for  an  order  of  conditional  independence  equal  to 
one  will  be  clear  after  this  discussion;  and  it  will  be 
easily  generalized  for  values  greater  than  two.  The  func- 
tional form  assumed  for  both  955  9*^9  period  i 

is  the  following: 
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(4.5) 


a + h (f (i-1) ) + h (f  (i-1)  ,f  (i-2) ) . 

0 1 

This  form  is  completely  general  and  complements  the  assess- 
ment procedure  very  nicely.  a^  is  a constant.  h^(f(i-l)) 
is  a function  of  only  the  previous  value.  The  graphs  of 

x(i|i-l)  and  x(i|i-l)  versus  x(i-l)  will  be  used  to 

0.5 

specify  its  preliminary  form.  h^ ( f ( i-1 ) , f ( i-2 ) ) will  then 
be  specified  by  the  remaining  graphs  obtained  in  the  pre- 
liminary assessment  phase.  Note  that  this  term  will  not  be 
present  wlien  i equals  two. 

For  nearly  every  assessment  that  we  have  done,  in  linear 
or  piecewise  linear  form  for  h^(f(i-l))  has  been  adequate 
for  both  q and  g*  . However,  any  functional  form  is 

0.5  0.9 

possible  as  long  as  the  constraints  of  those  two  models  are 
mot,  and  the  analyst  sliould  be  open  to  several  possibilities 
in  this  pliase  of  the  assessment  procedure. 

There  are  numerous  possibilities  for  h ^ ( f ( i-1 ) , f ( i-2 ) ) . 
Some  of  the  more  common  ones  will  be  discussed  here  and  are 
represented  by  the  graphs  in  Figure  4.4.  These  are  the 
typos  of  graphs  that  would  be  ascertained  in  the  last  two 
sections  of  the  preliminary  assessment  phase.  Since  g^  ^ 
and  q*  are  similar  in  terms  of  functional  forms,  we  will 
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only  discuss  g in  detail.  A few  words  will  bo  said 

“ . 5 

about  g*  later.  The  graph  in  Figure  4.4(a)  implies  that 

0 . 9 

there  is  no  real  interaction  between  f (i-1)  and  f(i-2) 


71 


’I 


in  the  term  (f  (i-1 ) , f (i-2 ) ) . This  is  the  type  of  be- 
havior implied  by  the  multivariate  named  distributions  and 
was  not  represented  in  our  assessments.  In  this  case 
another  linear  relationship 

a^  (f  (i-2)-a^)  (4.6) 

would  probably  be  adequate.  For  the  case  depicted  in  the 
figure  a^  would  be  positive  and  a^  would  equal  0.5.  At 
this  point  it  is  not  necessary  that  the  analyst  worry  about 
whether  the  constraints  of  g and  g*  are  met. 

or  ^09 

However  , the  constraints  can  be  used  to  change  the  above 
linear  expression  into  a nonlinear  one  in  such  a way  that 
the  constraints  are  not  violated.  This  can  best  be  explained 
with  the  aid  of  a graph.  Suppose  that  the  decision  maker's 
graph  of  x(i|i-l)  versus  x(i-l)  has  been  translated 

0,5 

into  a graph  of  g versus  f(i-l)  as  shown  in  Figure  4.5 

0,5 

by  the  solid  line.  The  beliefs  shown  in  Figure  4.4(a)  imply 
that  if  f(i-2)  were  0.75,  then  g would  be  above  the 

0 , 5 

solid  line  plotted  in  Figure  4.5  for  all  values  of  f(i-l). 
One  way  to  achieve  this  is  to  multiply  the  above  linear 
expression  for  h 

2 

a (f(i-2)  - a ) 

1 2 

by  the  distance  between  the  constraint  and  the  solid  line, 
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Figure  4.5.  The  effect  of  the  nonlinear  multiplicative 
factor 


(4.7) 


0 . 5-  (a  +a  f (i-1 ) ) • 

3 4 


This  new  expression  is 


a (f(i-2)-a  )(0.5-a  -a  f (i-1)  ) . 

1 2 3 4 


(4.8) 


The  dotted  line  in  Figure  4.5  represents  g for  f(i-2) 

0.5 

equal  to  0.75  and  a positive  value  of  a^.  If  f(i-2) 
were  less  than  0.5,  the  expression  would  be 


a (f(i-2)-a  ) (a  +a  f (i-1) - (-0 . 5 ) ) . (4.9) 

1 2 3 4 

This  nonlinear  expression  implies  the  same  general  behavior 
as  shown  in  Figure  4.4(a).  However,  the  decision  mailer's 
assessments  in  the  next  phase  must  be  used  to  determine 
whether  it  is  a better  characterization  of  his  beliefs  than 
the  strictly  linear  relationship.  Finally,  the  analyst  may 
want  to  try  nonlinear  functions  of  f(i-2)  also. 


The  graphs  in  Figure  4.4(b)  imply  that  the  trend  in 
prior  fractiles  is  the  important  characteristic  to  be 
captured  in  h^ (f (i-1 ) , f (i“2) ) . That  is,  if  f(i-2)  is 
less  than  f(i-l),  then  the  posterior  median  is  greater  than 
if  f(i-2)  equalled  f(i-l).  The  linear  form  of  this 
expression  is 

a^  (f  (i-l)-f (i-2) )+a^  (4.10) 
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where  a is  positive.  This  belief  prevailed  in  several  of 
1 

our  assessments  and  was  adequately  approximated  by  either 
this  linear  expression  or  the  nonlinear  expression  analogous 
to  equations  4.8  and  4.9  above.  Of  course  other  nonlinear 
expressions  can  also  be  used. 

Another  popular  belief  reflected  in  our  assessments  was 
the  one  depicted  in  Figure  4.4(c).  This  is  more  like  the 
correlation  behavior  of  the  multivariate  named  distributions, 
and  the  opposite  of  the  trend  behavior  in  Figure  4.4(b).  If 
f(i-2)  is  less  than  f (i-1) , then  the  posterior  median  is 
decreased.  The  linear  expression  for  this  behavior  is 
exactly  the  same  as  equation  4.10,  except  that  a^  is 
negative. 

Finally,  we  should  discuss  how  the  analyst  can  model  the 
decision  maker's  belief  that  his  posterior  medians  will 
describe  a cyclic  path  through  time.  There  are  two  ways  to 
do  this.  The  decision  maker  who  already  has  a lot  of 
information  about  this  cyclic  path  will  provide  a cyclic 
path  of  prior  medians  in  the  preliminary  assessment  phase. 
This  cyclic  path  of  prior  medians  and  any  of  the  above 
functional  forms  for  g will  result  in  a cyclic  path  of 
posterior  medians.  When  the  decision  maker  does  not  have 
much  prior  information  about  the  cyclic  path  of  the  drv  but 
will  be:  gaining  some  as  the  future  values  of  the  drv  are 
revealed,  a different  approach  must  be  taken.  In  this  case 


the  path  of  prior  medians  will  have  little  or  no  cyclic 
shape.  However,  a plot  of  the  revealed  values  of  the  drv  in 
prior  fractile  units  over  time  should  reveal  a cyclic  shape. 
This  cyclic  shape  can  easily  be  translated  into  a cyclic 
path  of  posterior  medians  by  letting  h^(f(i-l))  be  a 
decreasing  function  of  f(i-l).  Of  course,  there  are  also 
more  complex  ways  to  achieve  this. 

In  four  of  our  assessments  the  posterior  standard 
deviation  was  an  increasing  function  of  x(i-l)  and  was 
adequately  approximated  by  one  of  the  functional  forms 
described  above  for  the  posterior  median.  However,  a 
different  belief,  which  was  reflected  in  three  of  our 
assessments,  is  that  the  standard  deviation  is  either  an 
increasing  or  decreasing  function  of  the  distance  between 
the  actual  value  of  x(i-l)  and  x(iU)^^^.  That  is,  if 
x(i-l)  equals  the  decision  maker's  prior  median  in  period 
i-1,  then  his  posterior  standard  deviation  in  period  i is 
either  a minimum  or  maximum.  In  this  case,  h^  is  a 
function  of  | f (i-1 ) -0 . 5 | . A possible  permutation  of  this 
belief  for  !i=2  is  that  the  posterior  standard  deviation  in 
period  i is  either  a minimum  or  maximum  when  f (i-D 
equals  f (i"2) . 


The  last  step  is  to  determine  which  posterior  distri- 
butions are  to  be  assessed  in  the  final  assessment  phase  in 


order  to  find  the  parameters  of  g^  ^ and  g 


0.9 


There  are 
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no  special  techniques  for  doing  this  although  a few  rules  of 
thumb  are  useful.  It  is  a good  idea  to  assess  enough  posterior 
distributions  in  at  least  ^■hree  time  periods  so  that  the 
parameters  of  g and  g*  can  be  determined  completely 

0,5  0,:» 

for  each  of  these  time  periods.  Thus,  for  example,  the 
analyst  might  want  to  assess  four  or  five  posterior  distri- 
butions for  i equal  to  two,  four,  and  six.  If  h 

1 

and/or  h^  are  expected  to  be  nonlinear,  then  even  more 
posterior  distributions  may  be  needed.  Frequently  one  or 
more  parameters  of  g and  g*  are  functions  of  i. 

0.5  0.9 

For  this  reason  it  will  also  be  useful  to  assess  at  least 
one  or  two  posterior  distributions  for  all  or  nearly  all  of 
the  remaining  time  periods.  This  will  provide  the  infor- 
mation to  approximate  these  parameters  as  functions  of  i, 
if  necessary.  Finally,  the  analyst  should  guard  against 
assessing  too  many  distributions.  The  accuracy  of  the 
approximation  should  be  balanced  against  the  cost  of  the 
assessment.  A flow  graph  of  this  phase  of  the  assessment 
procedure  is  presented  in  Figure  4.6. 

4.4  The  Final  Assessment  Phase 


The  final  assessment  phase  will  hopefully  only  involve 
assessing  the  posterior  distributions  decided  upon  in  the 
preliminary  analysis  phase.  Again  the  assessment  techniques 
should  conform  to  those  described  in  [28] . However,  the 
analyst  should  be  checking  to  make  sure  that  the  medians  and 
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Approximate  the  assessed  prior  distributions 
by  the  appropriate  family  of  named 
distributions . 


Use  the  information  obtained  in  the  pre- 
liminary assessment  phase  to  postulate 
several  models  of  the  decision-maker's 
updating  process. 


Determine  the  posterior  distributions  to  be 
assessed  in  the  Final  Assessment  Phase. 


Figure  4.6.  The  preliminary  analysis  phase 


variances  of  the  assessed  posterior  distributions  correspond 
generally  to  the  behavior  described  by  the  decision-maker  in 
the  preliminary  assessment  phase.  Only  qualitative  checks 
by  the  analyst  are  required  here.  If  the  assessed  distri- 
butions do  not  exhibit  the  same  behavior  as  the  preliminary 
graphs,  then  the  decision  maker  should  be  consulted  and 
asked  to  decide  which  he  believes.  If  he  believes  the 
assessed  posterior  distributions,  then  the  analyst  may  want 
to  adjust  which  posterior  distributions  he  assesses.  If  the 
decision  maker  believes  the  graphs  he  drew  in  the  prelimi- 
nary assessment  phase,  then  he  should  change  the  appropriate 
posterior  assessments.  This  procedure  is  depicted  in  Figure 
4.7. 

4 . 5 The  Final  Analysis  Phase 

There  are  three  basic  steps  in  this  final  analysis 
phase.  The  first  is  to  approximate  the  posterior  distri- 
butions assessed  in  the  previous  phase  by  members  of  the 
appropriate  family  of  named  distributions.  The  same  process 
should  be  used  here  as  was  used  for  the  prior  distributions. 
Next,  g and  g*  should  be  calculated  for  each  of 

0.5  ^0,9 

these  posterior  distributions.  For  the  normal  family  the 
equations  used  for  this  purpose  would  be  3.4  and  3.11. 
Analogous  equations  can  be  found  in  Chapter  3.3  for  the 
other  families  of  named  distributions.  This  information 
should  then  be  used  to  solve  for  the  parameters  of  g 
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Assess  the  posterior 
distributions . 


and  g*  . There  are  two  methods  that  can  be  used  to  find 

0 . 9 

these  parameters.  Since  all  of  the  updating  models  dis- 
cussed in  Section  3 are  linear  in  terms  of  the  parameters, 
least  squares  can  be  used.  Each  assessed  posterior  distri- 
bution would  provide  a data  point  for  the  parameter  of  both 
the  median  and  standard  deviation  updating  models.  Care 
should  be  taken  however  to  determine  whether  any  of  the 
parameters  should  be  functions  of  the  period  i.  The  second 
method  is  a graphical  one  which  will  be  discussed  in  the 
next  chapter. 

At  this  point  it  would  be  wise  for  the  analyst  to 
compare  the  assessed  posterior  distributions  to  the  approx- 
imate ones  given  by  the  prior  distributions  and  g and 

^ ^ 

g*  . He  should  be  convinced  that  the  approximation  is 

0 . 9 

sufficiently  accurate  for  the  decision  analysis.  Otherwise 
he  may  want  to  try  more  complex  functions  for  g and 

g*  . Figure  4.8  presents  a flowchart  for  this  phase. 

0.9 

4 . 6 The  Verification  by  the  Decision  Maker 

By  this  time  the  first  step  in  the  verification  pro- 
cedure has  been  comoleted.  That  is,  the  deicison  maker  and 
analyst  have  agreed  on  the  general  forms  of  9^  ^ g- 

Now  all  that  has  to  be  determined  is  whether  the  approxi- 
mation is  good  enough  so  that  the  decision  maker  is  willing 
to  use  it  in  the  determination  of  his  optimal  decision.  The 
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Approximate  the  assessed  posterior  distributions 
by  the  appropriate  family  of  named  distributions 


Calculate  gg  ^ and  9q^9  each  of  the 

assessed  posterior  distributions. 


Calculate  the  parameters  of  ^0.9 

for  the  several  preliminary  models  postulated 
in  the  Preliminary  Analysis  Phase. 


Choose  the  two  models  that  give  the  best  fit 


Compare  the  approximated  posterior  distributions 
to  the  assessed  ones.  ^ 


Try 
more 
complex 
models . 


Adequate: 


Figure  4.8.  The  final  analysis  phase 


first  step  is  to  show  the  decision  maker  the  comparisons 
between  his  assessments  and  the  approximations  which  were 
computed  in  the  final  analysis.  If  he  feels  these  approx- 
imations are  adequate,  the  analyst  should  assess  several  new 
distributions  for  which  he  has  already  prepared  approximations. 
If  these  approximations  are  also  close  enough,  then  the 
decision  maker  will  most  likely  accept  the  approximation. 

If  not,  the  analyst  should  determine  what  has  gone  wrong. 

Usually  it  will  be  that  there  is  a better  form  for  g or 

0 . 5 

9*  g • If  SO,  the  analyst  should  repeat  the  final  analysis. 

3y  agreeing  to  use  this  approximation  of  his  joint  distri- 
bution, the  decision  maker  is  saying  that  he  is  indifferent 
to  accepting  the  actual  values  of  x (1 ),  x (2 ),...,  x (N)  or 
values  generated  by  a simulation  using  this  approximate 
joint  distribution.  This  phase  is  depicted  in  Figure  4.9. 
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CHAPTER  5 


THE  ASSESSMENTS 


5.1  Introduction 


Our  sevon  assessTuents  are  discussed  in  this  chapter. 

The  next  section  provides  a general  description  of  the 
assessments,  including  a specification  of  the  drv's  and  a 
summary  of  the  total  errors  for  each.  A detailed  discussion 
of  one  of  these  assessments  is  presented  in  the  last  section. 


5 . 2 An  Overview  of  the  Assessments 

The  seven  drv's  whose  joint  distributions  we  assessed 

are: 

1.  The  yearly  population  of  San  Francisco  County  for 
the  years  1961,  1962,...,  1971  as  reported  by  the 
California  Statistical  Abstract  of  the  California 
Department  of  Finance 

2.  The  yearly  average  unemployment  percentage  in  the 
United  States  for  the  years  1960,  1961,...,  1970 

as  reported  by  the  Economic  Report  of  the  President 

(1971) 
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3.  Annual  earned  income  in  1976  dollars  for  the  years 
Sept.  1976  - Sept.  1977,  Sept.  1977  - Sept.  1978,..., 
Sept.  1985  - Sept.  1986 

4.  The  yearly  average  price  of  per  pound  for  the 

years  1977,  1978,...,  1986  given  that  the  current 
operating  reactors  are  not  shut  down  and  plutonium 
recycle  is  allowed 

5.  Annual  income  in  1976  dollars  from  entrepreneurial 
activities  for  the  years  1977,  1978,...,  1986 

6.  The  price  of  one  share  of  Golden  Cycle  stock  at 
the  close  of  business  one  week  after  the  release 
of  each  Quarterly  Report  from  July,  1976,  through 
April,  1978 

7.  The  yearly  United  States  budget  in  1976  dollars 
for  the  years  1977,  1978,...,  1986. 

Table  5.1  presents  some  general  information  about  each 
assessment.  The  first  column  lists  the  name  of  the  drv.  In 
the  second  column  is  the  number  M of  posterior  distri- 
butions that  were  assessed  and  used  to  determine  g and 

0,5 

q*  . This  number  ranged  between  12  and  18.  The  value  of 

^0,9 

in  the  third  column  is  the  number  of  posterior  distri- 
butions that  were  assessed  but  not  used  in  the  determination 
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TABLE  5.1 


A Summary  of  the  Assessments 


Variable 

N 

M 

^1 

i 

Population  of 

San  Francisco 

11 

15 

5 

3 

Unemployment 

Percentage 

11 

18 

5 

2 

Income 

j 

10 

14 

4 

1 

Price  of  U^Og 

10 

14 

4 

2 

Entrepreneurial 

Income 

10 

17 

4 

2 

Price  of  Golden 

Cycle  Stock 

8 

12 

4 

2 

U.S.  Budget 

(10^) 

10 

18 

4 

2 
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of  the  updating  algorithms.  These  assessments  were  used  to 
provide  a check  on  the  interpolation  error.  The  order  of 
conditional  independence  is  listed  in  the  last  column.  As 
stated  in  Chapter  4 this  nun±)er  varied  between  one  and  three 
for  the  drv's. 

The  errors  for  these  assessments  in  terms  of  the 
average  percent  are  presented  in  Table  5.2. 

/\ 

M I p r j 

error  = E -I — — L 

j=i  6 

where  6 was  the  assessed  value 

A 

<S  was  the  approximate  value. 

The  four  categories  that  the  error  was  computed  for  are  the 
median,  standard  deviation,  and  two  assessed  fractiles 
(either  0.1/0. 9 or  0.25/0.75).  The  top  number  for  each 
assessment  in  each  column  is  the  error  found  in  comparing 
the  assessed  posterior  distributions  that  were  used  to 
determine  the  updating  algorithms  to  their  corresponding 
approximations  using  the  updating  algorithms.  These  numbers 
for  the  median  and  standard  deviation  reflect  the  curve- 
fitting error  only.  However,  the  errors  for  the  outside 
fractiles  are  a combination  of  curve-fitting  error  and  named 
distribution  error.  The  numbers  in  parentheses  are  the 
associated  errors  for  the  four  or  five  posterior  distributions 
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TABLE  5.2 


The  Assessment  Errors 


Variable 

Median 

Standard 

Deviation 

0.1/0.25 

Fractile 

0.75/0.9 

Fractile 

Population  of 

0.005 

0.109 

0.019 

0.006 

San  Francisco 

(0.003) 

(0.118) 

(0.015) 

(0.005) 

Uneniployment 

0.023 

0.179 

0.031 

0.027 

Percentage 

(0.057) 

(0.171) 

(0.054) 

(0.068) 

Income 

0.027 

(0.031) 

0.065 

(0.132) 

0.038 

(0.044) 

0.031 

(0.038) 

Price  of  U^Og 

0.018 

(0.024) 

0.050 

(0.142) 

0.062 

(0.033) 

0.029 

(0.071) 

Entrepreneurial 

0.048 

0.072 

0.087 

0.044 

Income 

(0.083) 

(0.051) 

(0.087) 

(0.091) 

Price  of  Golden 

0.015 

0.057 

0.053 

0.036 

Cycle  Stock 

(0.023) 

(0.198) 

(0.C40) 

(0.054) 

U.S.  Budget 

0.030 

0.183 

0.098 

0.060 

9 

do'') 

(0.072) 

(0.309) 

(0.172) 

(0.012) 
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that  were  not  used  to  determine  the  updating  algorithm. 

These  numbers  in  parentheses  are  our  only  check  on  inter- 
polation error. 

The  errors  for  the  posterior  medians  are  very  small  in 
comparison  to  what  the  individuals  considered  to  be  their 
own  assessment  error.  Also,  the  interpolation  error  in  this 
case  appears  either  insignificant  or  absent. 

However,  the  curve-fitting  error  for  the  posterior 
standard  deviations  is  larger  than  that  for  the  medians  in 
every  case.  In  the  second  and  seventh  assessments  it  appears 
to  border  on  the  unacceptable.  Some  mitigating  circum- 
stances are  that  the  individuals  generally  thought  their 
assessment  errors  for  the  outside  fractiles  that  determined 
the  standard  deviation  were  greater  than  the  corresponding 
error  for  the  medians.  Also,  they  were  more  concerned  that 
the  general  behavior  of  the  standard  deviation  updating 
algorithm  matched  their  beliefs  than  that  these  errors  be 
minimized  by  using  a lot  of  superfluous  terms.  In  fact, 
once  several  of  the  individuals  were  happy  with  g*  ^ , they 
were  willing  to  change  some  of  their  assessments  to  match 
the  approximation.  Finally,  as  shown  by  the  numbers  in  the 
last  two  columns,  large  errors  in  the  posterior  standard 
deviations  do  not  necessarily  mean  large  errors  in  the  other 
fractiles  of  the  distributions.  For  these  reasons  larger 
errors  are  acceptable  in  the  standard  deviation  updating 
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algorithm  and  all  of  the  individuals  were  willing  to  accept 
these  errors.  The  numbers  in  parentheses  indicate  that  in 
some  of  these  cases  the  interpolation  error  may  be  large. 
However,  these  numbers  do  not  reflect  interpolation  error 
alone  and  are  influenced  by  all  of  the  above  factors. 

The  errors  in  the  outside  fractiles  are  acceptable 
considering  assessment  error.  This  indicates  that  the  error 
introduced  into  a decision  analysis  by  using  these  approxi- 
mated posterior  distributions  is  within  the  acceptable 
region.  In  fact,  all  of  the  individuals  said  they  would  be 
willing  to  use  these  approximations. 

5.3  The  Assessment  of  the  Price  of  U 0 

38 


A detailed  discussion  of  the  assessment  of  a joint 
probability  distribution  on  the  following  drv  is  provided  in 
this  section; 

The  yearly  average  price  of  U 0 per  pound 
for  the  years  1977,  1978,...,  1986  given 
that  the  current  operating  nuclear  reactors 
are  not  shut  down  and  plutonium  recycle  is 
allowed. 
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U 0 is  a uranium  oxide  ore  that  is  mined  and  purified  for 

3 8 

use  as  a fuel  for  nuclear  power  plants.  The  individual  who 
played  the  decision  maker  or  expert  role  for  these  assess- 
ments is  a nuclear  engineer.  While  this  drv  was  not  part  of 
a decision  analysis,  it  is  clearly  the  type  of  variable  for 
which  a joint  distribution  might  be  required. 

Note  that  the  yearly  price  is  conditioned  on  two 
events:  (1)  the  current  operating  nuclear  reactors  are  not 

shut  down  and  (2)  plutonium  recycle  is  allowed.  This  is  the 
type  of  modeling  that  was  referred  to  in  Chapters  3 and  4. 

The  expert  initially  felt  that  the  drv  should  be  conditioned 
on  the  first  event  above  in  order  to  keep  the  joint  distri- 
bution free  of  wild  types  of  behavior.  Then  during  the 
final  assessment  phase  his  assessed  posterior  distributions 
were  exhibiting  certain  erratic  forms  of  behavior  that  were 
traced  to  the  resolution  of  the  plutonium  recycle  question 
around  the  year  1980.  For  this  reason  the  drv  was  condi- 
tioned on  this  event  also.  In  an  actual  decision  analysis  a 
sensitivity  analysis  of  the  decision  to  these  newly  defined 
drv's  would  be  performed  to  determine  whether  two,  one,  or 
no  joint  probability  distribution (s ) should  be  assessed. 

Since  the  expert  was  very  familiar  with  the  theories  of 
decision  analysis  and  probability,  the  initial  steps  of  the 
preliminary  assessment  procedure  were  dispensed  with  quickly. 
The  prior  distributions  were  encoded  for  the  years  1977 
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through  1986  and  are  represented  by  the  0.1,  0.5,  and  0.9 
fractiles  in  Figure  5.1.  As  can  be  seen  in  this  figure,  the 
price  of  U 0 is  generallv  expected  to  rise.  The  prior 

^ 3 8 

distributions  are  not  exactly  siTronetric  but  are  close. 

Next,  the  order  of  conditional  independence  was  ascertained 
to  equal  two.  During  this  assessment  process  the  expert  was 
not  asked  to  draw  the  graphs  that  are  part  of  the  final 
stages  of  the  preliminary  assessment  phase.  However,  we  did 
discuss  the  essence  of  these  graphs  so  that  they  can  be 
reconstructed  here  in  general  terms.  The  posterior  median 
of  x(i)  was  thought  to  be  an  increasing  function  of  x(i-l) 
as  shown  by  the  solid  line  in  Figure  5.2.  The  expert  felt 
that  the  prior  fractile  paths  were  very  likely  paths  for  the 
drv  to  follow  over  time  and  that  the  posterior  median  of 
x(i)  was  a function  of  the  trend  of  the  two  previous  prior 
fractiles.  That  is,  the  posterior  median  of  x(i)  is  also 
an  increasing  function  of  the  difference  between  the  re- 
vealed prior  fractiles  of  x(i-l)  and  x(i-2).  This  is 
indicated  by  the  three  dashed  lines  in  Figure  5.2  which 
represent  different  values  of  x(i-2) . This  same  relation- 
ship held  for  the  posterior  variance. 

The  first  step  of  the  preliminary  analysis  phase  is  to 
approximate  the  assessed  prior  distributions  by  the  appro- 
priate members  of  a named  distribution.  The  normal  distri- 
bution provided  a reasonably  accurate  approximation  of  the 
prior  distributions,  and  Table  5.3  shows  the  median  (mean) 


» 
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TABLE  5. 3 


The  Approximate  Prior  Distributions 


Year 

Moan 

Standard  Deviation 

1977 

34. 

8.2 

1978 

38. 

9.8 

1979 

40. 

11. 

1980 

41. 

13. 

1981 

44. 

14  . 

1982 

48. 

14  . 

1983 

54. 

17. 

1984 

55 . 

18. 

1985 

56. 

22. 

1986 

58. 

25. 
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and  standard  deviation  of  the  approximate  prior  distributions. 
Next  preliminary  forms  of  the  g and  g*  functions 

0^5  ® ^ 

were  postulated.  The  simplest  linear  form  is: 

a^i+ajf  (i-l)+a2(f  (i-l)-f  (i-2))  . (5.1) 

However,  other  nonlinear  forms  such  as  quadratic  or  loga- 
rithmic forms  could  be  used  if  needed  as  long  as  the  result 
is  an  increasing  function  of  f (i-1)  and  (f (i-1) -f (i-2 ) ) . 
Also,  the  last  term  of  equation  5.1  can  be  multiplied  by  the 
following  expression  which  was  discussed  in  Chapter  4.3: 

0.5-a  ^-ajf  (i-1) , f (i-l)>f  (i-2) 

r a +a  f(i-l)+0.5,  f (i-1) <f  (i-2) . 

0 1 

Finally,  the  analyst  must  choose  which  posterior  distri- 
butions to  assess  in  the  next  phase.  The  posterior  distri- 
butions encoded  in  this  assessment  are  listed  in  Table  5.4. 

The  posterior  assessment  phase  proceeded  smoothly  once 
the  yearly  average  price  per  pound  of  was  conditioned 

on  the  two  events  mentioned  above.  Since  the  explanation  of 
the  graphical  technique  for  defining  the  functional  forms 
and  parameters  of  g and  g*  requires  only  eight  of 

these  assessments.  Table  5.5  presents  the  results  of  the 
first  eight  posterior  distributions  in  Table  5.4. 
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TABLE  5.4 


The  Given  Information  for  the 
Assessed  Posterior  Distributions 


Year 

i 

x(i-2) 

X (i- 

1978 

2 

- 

34 

1978 

2 

- 

36 

1978 

2 

- 

40 

1978 

2 

- 

30 

1979 

3 

35. 

38 

1979 

3 

35. 

35 

1979 

3 

30. 

35 

1979 

3 

35. 

32 

1980 

4 

33. 

40, 

1980 

4 

38. 

44, 

1980 

4 

41. 

44. 

1980 

4 

44. 

42, 

1984 

8 

48. 

50, 

1984 

8 

• 

IT) 

54, 
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TABLE 


All  of  the  assessed  posterior  distributions  were 
approximated  by  normal  distributions  in  the  first  step  of 
the  final  analysis  phase.  These  normal  distributions  are 
also  tabulated  in  Table  5.5  for  the  first  eight  posterior 
distributions.  Next  the  values  of  g and  q*  are 

^0.5  ^0,9 

calculated  for  each  of  these  distributions  using  equations 
3.4  and  3.11.  These  values  are  also  shown  in  Table  5.5. 

The  next  step  in  this  phase  of  the  assessment  procedure 
is  to  use  the  assessed  posterior  distributions  to  completely 
define  the  forms  and  parameters  of  g and  g*  . As  was 

0,5  0,9 

mentioned  in  Chapter  4.5,  thir.  can  be  done  by  using  least 
squares  to  find  the  parameters  for  several  different  forms 
of  these  models.  However,  we  have  used  a graphical  procedure 
that  provides  both  the  intuitive  and  computational  infor- 
mation needed  by  the  analyst  for  choosing  the  forms  and 
parameters  of  the  two  models.  First  g.  , is  plotted 

0,5 

versus  f(l)  for  the  four  assessed  posterior  distributions 
in  1978.  This  graph  is  shown  in  Figure  5.3.  The  four 
distributions  are  represented  by  dots.  The  straight  line 

-0.62+1.12  f(l) 

provides  a close  approximation.  Thip  approximation  would 
not  be  improved  much  by  a nonlinear  model  so  none  was 
investigated.  Next  we  plot  g versus  f(2)  for  the 

0,5 

three  posterior  distributions  on  x(3)  which  have  a given 
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.alueof  x.l)  e,ualtc>3S.  The  .ots  in  ^ure  3.4  rep- 
resent these  three  aistrihutions.  The  prior  fractUe  o 

• 4-rh  is  0 55.  These  three  points  are 
x(l)  corresponding  to  35  i 

very  accurately  approximated  by  the  solid  straight  line 

in  order  to  be  consistent  with  the  statements  of  t e 

n4-  nhase  this  solid  line  must  intersec 
preliminary  assessment  phase,  tn 

the  line  representing  g..,  when  fd,  = ^t  f<2. 

egual  to  0.33.  The  dotted  line  in  Figure  3.4  represents  g 

„hen  f(l>  = fU,  and  has  the  same  slope  although  drfferent 

s-  • p-ionre  5 3.  The  last  posterior 
intercept  as  the  line  m Figure  5.  ^ ^ 

is  represented  by  the  circle  m 
distribution  on  x(3)  P 

Figure  5.4.  It  corresponds  to  fd)  = 0.31  and  f 

and  should  lie  slightly  above  the  dotted  line  rather  than 

,3low.  Howeyer.  this  is  still  a reasonable  approx- 

Lmation.  These  assessments  indicate  that  the  li 


0.5 


. rariomiate  The  final  form  of  g 

is  very  adequate. 


0.5 


period  is  as  follows: 


0,5 


a (i) 
1 


£(0) 


a 


i 


r 


(i)+1.12f(i-l)  + .29(f  (i-D-f 
-.62  i=2 

-.52 

-.59  i“4 


-.56 


i>4 


£(1)  when  i*=2. 


(5.2) 


. \ The  value 

ete  that  only  the  intercept  is  a function  of  i. 

, a.(i,  for  i greater  than  4 was  ascertained  by  the 
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last  two  assessments  and  information  gathered  in  the  pre- 
liminary assessment  phase.  The  expert  stated  that  the 
posterior  median  in  periods  five  through  ten,  given  that  the 
previous  path  was  the  prior  medians,  was  equal  to  the 
corresponding  prior  median.  Finally,  it  should  be  noted  that 
there  are  values  of  f(i-2)  and  f(i-l)  for  which  g , 

0.5 

as  stated  above,  violates  its  constraints.  .qince  the  linear 
form  is  so  accurate  for  nonextreme  values  of  f(i-l)  and 
f(i-2),  we  decided  to  add  a condition  that  would  modify  the 
value  of  g only  when  it  was  near  or  in  actual  violation 

of  a constrai’  c.  For  instance  we  used  the  following  scheme: 

if  g >0.4,  g = (g  -0.4)  (max  g -0.4)  (5.3) 

'0,5  0,5  0,5  0,5 

if  g <-0.4,  g =- (-g  +0.4) (min  g +0.4). 

0.5  0,5  0.5  0,5 

This  insures  that  the  constraints  are  met. 

The  procedure  for  determining  g*  ^ is  exactly  the 
same.  Figure  5.5  shows  g*  plotted  versus  f(l)  for  the 

0.9 

four  posterior  distributions  on  x(2).  Again  a straight 
line  seems  to  be  the  best  approximation.  The  straight  line 
depicted  is 

-0. 175  + 0.15  f (1)  . 

The  three  dots  in  Figure  5.6  represent  the  posterior  distri- 
butions on  x(3)  when  x(l)  equals  35  (or  f(l)  0.55). 
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Figure  5.5  9^  9 versus  f(l)  for  i=2 
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They  also  are  closely  approximated  by  a straight  line. 

Again  the  dashed  line  in  this  figure  intersects  the  solid 
line  at  f(2)  equal  to  0.55  and  has  the  same  slope  as  the 
line  in  Figure  5.5.  The  circle  in  Figure  5.6  represents  the 
last  posterior  distribution  on  x(3),  with  f(l)  = 0.31  and 
f(2)  = 0.38.  In  this  case  it  lies  directly  on  the  dashed 
line  rather  than  slightly  above  it.  The  final  form  of  g* 


g*  = a Ji)  + .15f  (i-l)  + .35(f  (i-l)-f  (i-2)) 

U . a ^ 


r-.i75 

i=2 

(-.095 

i=3 

(5.4) 

-.235 

i>3 

f (0 ) = f (1 ) when  i=2 . 

Again  the  intercept  is  the  only  parameter  that  is  a function 
of  the  period.  The  constraints  are  much  more  likely  to  be 
violated  for  g*  . But  since  the  linear  form  is  again  very 

0.9 

accurate,  the  same  strategy  as  was  used  for  g*  was  used 

0.9 

to  meet  the  constraints. 

The  next  step  is  to  compute  the  approximated  assessed 
posterior  distributions  and  compare  them  with  the  assess- 
ments. Table  5.6  presents  this  comparison.  The  last  four 
distributions  are  additional  assessments  that  were  done  at 
the  same  time  as  the  other  posterior  distributions  but  which 
were  not  used  ...o  determine  the  forms  or  parameters  of  g 
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TABLE  5.6 


Comparison  of  Assessed  and 
Approximate  Posterior  Distributions 


Assessed 

Approximate 

Assessed 

Approximate 

Standard 

Standard 

Median 

Median 

Deviation 

Deviation 

36 

37 

6.2 

6.4 

40 

39 

7.0 

6.8 

45 

44 

7.8 

7.5 

30 

31 

5.9 

5.6 

41 

41 

9.8 

9.6 

36 

36 

7.4 

7.5 

37 

38 

10.6 

10.6 

31 

31 

5.5 

5.9 

40 

40 

6.2 

6.7 

47 

4 7 

9.0 

9.1 

46 

46 

7.4 

7.6 

39 

41 

6.6 

5.3 

51 

49 

7.4 

7.2 

54 

53 

7.4 

6.7 

44 

44 

8.6 

10.0 

35 

34 

6.6 

5.4 

56 

55 

8.6 

9.0 

60 

57 

10.2 

8.4 

and  g*  . The  approximate  and  assessed  medians  are  very 

0.9 

close,  the  maximum  error  being  five  percent.  The  approxi- 
mate and  assessed  standard  deviations  are  also  close  with  a 
few  significant  errors.  The  expert  stated  that  he  felt 
these  comparisons  and  the  general  behavior  of  9^  ^ 9*  ^ 

captured  his  uncertainty  with  enough  accuracy  that  he  would 
use  this  joint  probability  distribution  in  a decision 
analysis  if  it  were  needed  and  he  were  the  decision  maker. 
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CHAPTER  6 


CONCLUSIONS  AND  SUGGESTIONS  FOR  FURTHER  RESEARCH 


6 . 1 Conclusions 

We  began  by  examining  the  problem  of  assessing  uncer- 
tainties on  dynamic  random  variables.  These  variables  are 
one  of  the  basic  building  blocks  in  models  of  decisions 
involving  dynamic  situations.  The  previous  work  in  this 
area  is  scarce,  and  this  research  presents  a method  for 
dealing  with  the  complexities  of  this  problem. 

Multivariate  named  distributions  were  demonstrated  to 
be  inadequate  approximations  of  decision  makers'  joint 
distributions  in  general.  This  inadequacy  is  a res>..lt  of 
the  rigid  updating  implications  of  these  named  distribu- 
tions. A decision  maker  would  have  to  have  very  special 
beliefs  about  how  his  prior  distributions  are  updated  to 
posterior  distributions  to  be  willing  to  use  either  the 
normal,  lognormal,  or  Student  distributions. 

A method  that  approximates  the  decision  maker's  un- 
certainty by  modeling  his  updating  beliefs  was  presented  in 
Chapter  3.  This  method  was  designed  to  approximate  accu- 
rately almost  any  probabilistic  beliefs  a decision-maker 
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might  have  about  a drv.  It  was  also  designed  so  that  the 
assessment  procedure  could  be  as  short  as  possible  and  use 
state-of-the-art  encoding  techniques.  Finally,  it  has  a 
robust  mathematical  framework  so  that  only  a reasonable 
number  of  assessments  are  required  to  specify  fully  the 
approximation  of  the  decision  maker's  beliefs.  The  assess- 
ments we  have  done  verify  that  this  method  does  indeed 
provide  useful  and  accurate  approximations  of  joint  proba- 
bility distributions. 

Chapter  4 describes  the  assessment  procedure  that  was  re- 
fined in  the  process  of  doing  our  assessments.  It  has 
proven  to  be  helpful  to  the  decision  maker  in  thinking  about 
his  beliefs.  It  also  provides  a systematic  process  for  the 
analyst  to  determine  the  approximation  of  these  beliefs  and 
gather  the  information  needed  to  quantify  them.  The  example 
in  Chapter  5 illustrates  this  procedure  in  detail. 

6 . 2 Suggestions  for  Further  Research 

This  research  is  a first  step  into  the  realm  of  quan- 
tifying uncertainty  on  dynamic  random  variables.  It  is 
hoped  that  this  research  will  become  a point  of  departure 
for  future  research  in  this  area.  First  it  will  be  an  aid 
to  understanding  the  problem,  but,  more  importantly,  a tool 
for  solving  the  problem  so  that  experience  can  be  gained  in 
dealing  with  complex  stochastic  systems.  By  using  the 
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method  developed  in  this  research,  the  analyst  ••'ill  gain 
insight  into  the  forces  which  drive  different  types  of 
probabilistic  beliefs.  This  experience  should  generate  a 
better  understanding  of  the  proprieties  of  various  types  of 
stochastic  models  for  generating  the  decision  maker's 
probabilistic  beliefs.  This  is  the  more  direct  but  diffi- 
cult solution  to  this  problem.  Currently,  only  linear 
stochastic  dynamic  models  of  a dynamic  random  variable  (s) 
are  used  with  any  frequency  and  understood  completely. 
However,  as  stated  in  Chapter  1 they  are  the  equivalent  of  a 

^ ^ normal  distribution  which  few  decision  makers 
would  accept. 

To  complement  this  e-\perience,  future  researchers  should 
explore  the  recent  research  on  nonlinear  filtering  theory. 
This  research  does  not  provide  the  answers  needed  in  decision 
analysis  because  of  the  difference  in  the  problems  with 
which  each  are  concerned.  The  control  engineer  typically 
models  systems  in-the-small  and  has  to  be  able  to  handle  a 
great  deal  of  data  in  a short  period  of  time.  Conversely, 
the  decision  analyst  models  systems  in-the-large  and  has  to 
make  the  best  use  of  the  little  data  he  can  find.  However, 
it  is  possible  that  a thorough  understanding  of  nonlinear 
filtering  theory  and  more  experience  with  dynamic  random 
variables  in  future  decision  analyses  will  provide  valuable 
insights  to  this  problem. 


APPENDIX  A 


NOTATION 


a , . - a constant 

( • ) 

c(i)  - the  consumption  in  period  i 

C - a normalizing  constant  for  the  Student  distribution 
f - the  fractile  of  a probability  distribution, 
f(j)  - the  prior  fractile  of  the  revealed  value  of  the 
drv  in  period  j 

fg(x|X)  - the  density  function  of  the  exponential  distri- 
bution 

(x|y,£)  - the  multivariate  lognormal  density  function 
of  dimension  N.  If  N=l,  the  superscript 
is  omitted. 

f^^^  (x|y,£)  - the  multivariate  normal  density  function 

of  dimension  N 

f^^^  (x|n,y,T)  - the  multivariate  Student  density  function 

of  dimension  N 

F(.j(x|',’)  - the  (•)  cumulative  function 

g^  - the  delta  in  fractile  units  that  satisfies 

g*  - the  distance  in  fractile  units  from  the  prior  f 
fractile  to  the  posterior  cumulative 
h^ ( • ) - a function 
h2  ( • f • ) - a function 
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i - a discrete  time  indicator 

j - a discrete  time  indicator 

k - a discrete  time  indicator 

I - the  order  of  conditional  independence 

n - the  degree  of  freedom  parameter  of  the  Student  distr 

bution 

N - the  number  of  discrete  time  periods 
P - the  precision  matrix  of  the  multivariate  normal 
distribution 

q - a discrete  time  indicator 
t - continuous  time 

T - the  precision  matrix  of  the  multivariate  Student 
distribution 

W - the  covariance  matrix  of  the  multivariate  Student 
distribution 

X - the  N-dimensional  vector  of  values  of  the  drv 

x(i)  - the  value  of  the  drv  in  period  i 

y - the  standardized  normal  variate,  fj^(y!0fl) 

z - an  N-dimensional  variable 

z(i)  - the  value  of  z in  period  i 

a - a parameter  of  the  Weibull  distribution 

B - a parameter  of  the  Weibull  distribution 

r(-)  - the  gamma  function 

0 - the  N-dimensional  vector  of  values  of  an 
unobservable  drv 

0 (i)  - the  value  of  6 in  period  i 
X - a parameter  of  the  exponential  distribution 
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lAIL 


p - the  N-dimensional  vector  of  the  normal,  lognormal, 
Student  distributions 
IT  - the  constant  3.1415... 

p.  . - the  correlation  coefficient  between  the  i and 

13 

j values  for  the  multivariate  normal  distribut^-on 
I — t.hG  covariance  matrix  of  the  normal  and  lognormal 
distributions 

T - a length  of  continuous  time 

(•)'  “ the  transpose  of  the  vector  or  matrix  (•) 

The  following  is  a description  of  the  inferential  notation: 

js!  - a state  of  information 
^ - the  prior  state  of  information 

{xl«/}  - the  density  function  on  x given  state  of 
information  ^ 

<x  [^>  - the  expected  value  of  x given  state  of 
information  jtd 

Yx  lg;£>  - the  variance  of  x given  state  of  information  ^ 
(.)f  - the  f fractile  of  (•) 

~ a dummy  variable 

x(i|0£  ” the  prior  f fractile  of  x(i) 

x(i|i-l)f  - the  posterior  f fractile  of  x(i)  given  the 
values  of  x (1) , . . • rX (i~l) 
xdlO  - the  prior  variance  of  x(i) 

x(ili-l)  - the  posterior  variance  of  x(i)  give'  r ne 
values  of  x (1^ » • • • » x (i-l) 
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S .1,  - the  prior  standard  deviation  of  x(i) 

X (i  I c,) 

c I - the  posterior  standard  deviation  of  x(i) 

■^x(i|i-l) 

given  the  values  of  x(l),...»x(i~l) 
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APPENDIX  B 


PROOF  OF  EQUATION  2,7 


This  appendix  gives  a proof  of  the  following  propo- 
sition : Let  N random  variables , x(l),  x(2),...,  x(N), 

be  described  by  any  joint  probability  distribution 
{x (1) ,x (2) , . . . ,x  (N)  1 U . Define  the  posterior  mean  of  any 
x(i)  given  a subset  j {l<j<N-l)  of  the  remaining  N-1 
random  variables. 


<x(i)  |x(l)  ,x(2) 


X ( j ) , .^  > 


(i=2 


N) , (i>j  ) . 


Note  that  we  can  denote  this  subset  as  x(l),  x(2),..., 
x(j)  without  any  loss  of  generality.  Then  if  this 
posterior  mean  is  a linear  combination  of  x(l),  x(2),...f 
X ( j ) : 


<x(i)  |x(l)  ,x(2)  , ..  . ,x(j) 

a +a  x(l),+a  x (2 ),  + ... +a.x  (j ), , 
0 1 V 2 <P  J V 


Where  a ,a  ,...,a.  are  constants,  the  prior  mean  of  x(i) 
oil 

is  equal  to  this  linear  combination,  evaluated  at  the  prior 
means  of  x (1) ,x  (2) , . . . ,x( j) . 


<x  (i)  I 


a +a  <xU)  U>+a  <x  ( 2 ) | C>+ • • • ( j ) I • 
0 1 2 
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The  proof  of  this  is  a direct  integration  of  the 
appropriate  multiple  integral.  The  prior  mean  is  defined 


to  be 


<x(i)  I '^x(l)'^x(2)  " " , . . . ,x(N)  jc)  . 

This  can  easily  be  reduced  to 


< X ( i ) 1 > 

•^xd) 

•^x(2) 

•^X 

(j)  ’^x  (i)-'^^^^  • 

X ( j ) , 

x(i)  ! 

Cl 

" -^xd) 

■^x  (2) 

• • 

X (1)  , 

s } . 

{x 

(1) 

, . . . / X { j ) 1 C ) 

<x (i) 1 

" -^xd) 

•^x(2) 

• • 

^j^‘'X(i)  |x(j)f...^x(l)d^* 

{ X ( 1 ) , . . . , X ( j ) I U 

^ -^x  (D-^x  (2)  • "-^x  ( j ) + 

{x  (1) , . . . ,x  ( j ) ! 

= a^+a^  X (1)  {x  (!)  I \ } + . . . (jjX(j)^x(j)  lO 

= a +a  <x  (1)  I C^  + . . . . <x  ( j ) I f,>  . 
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APPENDIX  C 


THE  POSTERIOR  MULTIVARIATE  STUDENT  DENSITY  FUNCTION 


We  are  given  the  fact  that 


{x|U  = (xIn,y,T) 


= C (l+i(x-y)  'T(x-p)  ) 


where 


We  wish  to  calculate  {x  [x  where  x has  dimension 

—2—1  —1 

g and  x has  dimension  N-q.  We  know  by  the  definition 
2 

of  conditional  probability  that 


{x  |x 
—2  —1 


(i, I?} 


(xju  ■ 


The  probability  distribution  {x  |0  equals 


= 


f (x  n,u  ,T  -T  T"*T  ) 

O —1  -^1  —11  —12—2  2—2  1 


= 


(x  |n,u  ,W-M  . 
—1  -^1—11 
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Therefore 


{x  |x  ,U  = C' 
— 2 —1 


l+-(x-y) 'T(x-y) 


(n+N  \ 


l+^(x  -y  ) 'W-i (X  -y  ) 
n —1  -1  —1  1 —1  —1 


n+a 


(C.l) 


where 


Note  that  (l+^(x  - ]j) 'T  (x  - )j ) ) 


can  be  rewritten  as 


(l+i(x  -y  ) 'W-'  (X 
n —1  —1  —1  1 — 1 


) + 


i((x  -y  )+T"^T  (x  -y  ))’T  ( (x  -y  )+T”^T  (x  -y  ))). 

n —2  —2  —2  2 — 2 1 —1  —1  —2  2 “2  —2  —2  2—2  1 —1  “1 


Substituting  this  into  equation  C.l  and  multiplying  by 


1 


we  get 


{x  I X , U 
— 2 ' —1 


C" 


l+^(x 
n — 1 


-y 

— 1 


'W“* (x  -y  ) 
-1  1 -1  —1 


. l+-(x  -y  ) 'W-‘ (X  -y  ) 
L n -1  — 1 -11  —1  -1 


+ 


(n+N) 


-((X  -y  )+T-^T  (X  -y  ) ) 'T  ( (X  -y  )+T-;t  (X  -u  ) ) 
n —2  —2  —22—21  —1  —1  —22  —2  —2  —22—21  1 1 


l+-(x  -y  ) ' W~  (x  -y  ) 
n —1  —1  —1 1 —1  —1 


where  C" 


C (l+^(x  -y 
n —1  — 1 


-(N-q) 

' W“'  (x  -y  ) ) 

—1  1 —1  —1 


Thus 


{x  |x 

— 2 —1 

(x  -y 

—2  —2 


C" 


n+  (x  -y  ) ' VT  Mx  -y  ) 
—1  —1  -1  1 -1  -1 


- (n+N) 

— 5 — 


(X 

—2 


-y 

—2 


= C" 


1+ 


n+q 


(n+q)T 

—2  2 


n+ (x  -y  ) 'W"‘ (x  -y  ) 
-1  —1  -1  1 -1  -1 


- (n+q+N-q) 


) 


_ .(N-q) 

S 


^xjn+q,y^ 


_2  2 


n+  (x  -y  ) 'wMx  -y  ) 
— 1 —1  —1  1 —1  ~i 


where  y , 
-aji 


y -t-^t  (x  -y  ) . 
—2  —22—21  —1  “1 
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APPENDIX  D 


A DESCRIPTION  OF  A GENERAL  METHOD  FOR  UPDATING 

As  stated  in  Chapter  3,  the  function  g is  the 
vertical  difference  from  the  posterior  cumulative  to  the 
prior  at  the  f fractile  of  the  posterior  distribution. 

(See  Figure  D.l.)  Therefore  g is  also  defined  by  the 
equation 

^(i|i-l)f  = (D.l) 

or  the  prior  (f+g)  fractile  of  x{i)  equals  the  posterior 
f fractile  of  x(i)  . The  value  of  g depends  on  f as 
well  as  the  posterior  information. 


Some  of  the  outstanding  properties  of  g are  best 
illustrated  by  examining  it  for  the  two-dimensional  multi- 
variate normal  distribution: 


{x|U  = {x(l)  ,x(2)  |U 


1 

7W 


exp 


"5 


{D.2) 


X(l)' 

where  x = 

y{i) 

» y = . 

' L = 

a a 1 
11  12 

x(2) 

y(2) 

a 

a 

-> 

2 1 

2 2 J 

<x(i)  U>  = u (i)  (D.3) 
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r 


X ( i I f, ) = y ( i ) 

0.5 


(D.4) 


<x  (i)  I r,>  = 0^^  = c (i)  ‘ 


(D.5) 


Oij  = p.,o(i)o(j)  = 0.. 


11 


(D.C) 


\o , : o— 

\ 11  3D 


{x(2)  |x(l),C}  = I’,, exp 


where  P = I ’ = 


P P 

11  12 
P P 

2 1 2 2 


n 


4p  (x(2)-x(2|1)  ) 

222  0.5 

(D.7) 


X (2 1 1)  = <x  (2)  |x (1)  , r 


0 . 5 


2 1 


y(2)  + (x(l)-y(l)) 

0 


1 1 


y(2)  + pj^o(2) 


x(l)-vi  (1) 
0(1) 


= y (2)  + ^0  (2)y  (1) 


,2  \-i 


p = \ 0 
2 2 


■1  1 


<X(2)  lx(l)  ,f:>  = a(2)Ml-p;,) 
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Finally  for  the  normal  distribution  note  that 


= X 


(D.8) 


Therefore  for  the  prior  {x(2)|C}  and  posterior 
{x (2 ) I X (1 ) , ^ ) distributions  on  x(2) 


g ( f , y ( 1 ) ) = F 


n 


x(2|l)  - x(2|f;) 

t 0 . 5 

s 


0,1 


-f  (D.9) 


= F 


n 


x(2|U 
^x(2  lO 


0,1 


-f 


= F 


n 


0,1 


-f . 


First  note  that  g(f,y(l))  is  restricted  to  the  parallel- 
ogram shown  in  Figure  D.2(a).  If  x(l)  and  x(2)  are 
independent  then  g equals  zero.  If  x(l)  and 

x(2)  are  completely  dependent  (p  ^ = 1 or  = -1),  then  g 
equals  f(l)-f.  This  is  shown  in  Figure  D.2(b).  Finally, 
note  that  when  f(l)  equals  zero  (y(l)  = -~)  or  one 
(y(l)  = “) , g equals  zero.  By  examining  Figure  D.l,  it  is 
clear  that  these  three  relationships  hold  for  any  posterior 
and  prior  distributions. 


In  order  to  gain  some  insight  into  what  g as  a 
function  of  f for  given  values  of  y(l)  looks  like,  I have 
generated  the  following  figures.  Figure  D.3  depicts  g 


Figure  D.2.  Some  properties  of 


I 


versus  f for  equal  to  .5,  .75,  .9,  and  1.0.  It  is 

very  interesting  to  note  that  the  curve  for  equal  to 

0.9  is  only  about  halfway  between  the  curves  for  p equal 

1 2 

to  zero  and  one.  Graphs  of  g versus  f for  y(l)  equal 
to  .25  and  p^^  equal  to  .6,  .8,  and  1.0  are  shown  in 
Figure  D.4.  Examining  this  figure  closely  and  comparing  it 
to  Figure  D.3,  one  can  see  that  as  f(l)  moves  away  from  0.5, 
g gets  closer  to  the  limiting  straight  line.  f(l)-f,  for 
a given  value  of  p^^.  Examining  equation  (D.9)  reveals  that 
for  f(l)  equal  to  zero  or  one  g does  qqual  f(l)-f,  the 
limiting  case.  This  is  because  y is  unbounded. 

Before  leaving  this  example,  we  should  make  one  more 
observation.  If  x(l)  and  x(2)  were  transformed  to 
z(l)  and  z(2)  as  follows; 

X (1)  = In (z  (1) ) (D. 10) 

x(2)  = ln(z(2)), 

then  z (1)  and  z(2)  are  described  by  a multivariate 
lognormal  distribut ' on,  which  is  described  in  Chapter  2.3. 
However,  g{ffy(l))  is  equivalent  to  the  g for  the 
multivariate  distribution,  and  so  it  is  invariant  to  this 
change  of  variable. 

This  can  be  shown  to  hold  for  any  posterior  and  prior 
distribution  when  the  variable  undergoes  a monotonic 
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transformation  using  the  graphical  techniques  for  change  of 
variable  discussed  in  [11].  However,  it  does  not  hold  for 
non-monotonic  transformations. 

Now  let  us  examine  g for  the  general  method  described 
in  Chapter  3.  We  will  do  this  for  the  case  that  all  of  the 
prior  and  posterior  distributions  are  normal  distributions. 
Let  us  assume  that  we  have  defined  g and  q*  to  be 

0.5  ^0.3 

functions  of  f(l)  for  i equal  to  two.  We  have  the 
following  relationship  from  above  since  all  of  the 
distributions  are  normal: 


g(f,f(l))  = 

5'^^f®x(2  jl)"^  0 . 5 

0,1 

n 

®x(2|l) 

Using  equations  3.3  and  3.12  we  get 


g(f,f(l))  = 

F;'(0.5+g  Jo,i)+/  F;;-(0.9+g;  , 

0,1) 

L 

’ 0,9  ' 

0,1 

-f . 

(D.12) 

This  equation  can  be  seen  to  satisfy  all  of  the  general 
properties  mentioned  above. 
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APPENDIX  E 


PROOF  OF  EQUATIONS  3.21  AND  3.23 


The  general  form  of  equations  3.21  and  3.23  is 


X (i  I i-l)£  = F^^  (f+g£  |y{i|O/0(iU))  • 


Solving  for  (f+g^)  yields 


f+gf  = F^j^(x(i|i-l)^.Iy(iU)/a(iU)) 


= F 


n 


In  (x  (i  I i-1)  - y (i  U ) 

a (i  U) 


0,1 


by  equation  3.19.  Now  solving  for  the  argument  of  the 
normal  cumulative  and  rearranging 


lnfx(i  I i-1)  .)  - In  (xdj^)  ) 


f ^ P-1  (f  + g 


0 (i  U) 


n 


0,1) 


or  x(i|i-l)  ^ = x(i  U)  ^ (exp(a(iIO)  F^Mf+g^  I 0 , 1)  ) 

V * V 
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knowledge  of  the  variable  is  roughly  equivalent  to  his  knowledge  of  its 
components.  This  dissertaion  addresses  the  problem  of  performing  the 
assessment  of  a joint  probability  distribution  on  a dynamic  random  variable 
in  a practical  manner. y 

First,  multivariate  named  distributions  are  examined  and  found  to  be 
too  rigid  in  their  structure  to  be  good  approximations  of  the  decision- 
maker's joint  probability  distribution,  in  general. 

The  major  segment  of  this  dissertation  presents  a method  of  assessing 
a joint  probability  distribution  on  a dynamic  random  variable,  This 
method  is  a general  model  of  the  decision-maker's  use  of  new  information 
to  update  his  probabilistic  beliefs.  A mathematical  framework  for 
specifying  a posterior  distribution  in  terms  of  the  prior  distribution 
and  the  revealed  Information  is  introduced  here.  This  framework  provides 
the  analyst  with  a great  deal  of  flexibility  for  approximating  any  joint 
distribution  the  decision-maker  might  have. 


UNCLASSIFIED 


Cl  ASSI  p IC  AT  ION  OP  THIS  Dmf  Entered 

141 


